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Preface 


This quarterly publication provides archival reports on developments in programs 
managed by JPL’s Office of Telecommunications and Data Acquisition (TDA). In space 
communications, radio navigation, radio science, and ground-based radio astronomy, it 
reports on activities of the Deep Space Network (DSN) and its associated Ground Com- 
munications Facility (GCF) in planning, in supporting research and technology, in imple- 
mentation, and in operations. Also included is TDA-funded activity at JPL on data and 
information systems and reimbursable DSN work performed for other space agencies 
through NASA. The preceding work is all performed for NASA’s Office of Space Track- 
ing and Data Systems (OSTDS). 

In geodynamics, the publication reports on the application of radio interferometry 
at microwave frequencies for geodynamic measurements. In the search for extraterrestrial 
intelligence (SETI), it reports on implementation and operations for searching the micro- 
wave spectrum. The latter two programs are performed for NASA’s Office of Space 
Science and Applications (OSSA). 

Finally, tasks funded under the JPL Director’s Discretionary Fund and the Caltech 
President’s Fund which involve the TDA Office are included. 

This and each succeeding issue of the TDA Progress Report will present material in 
some, but not necessarily all, of the following categories: 

OSTDS Tasks: 

DSN Advanced Systems 

Tracking and Ground-Based Navigation 
Communications, Spacecraft-Ground 
Station Control and System Technology 
Network Data Processing and Productivity 
DSN Systems Implementation 
Capabilities for New Projects 
Networks Consolidation Program 
New Initiatives 
Network Sustaining 
DSN Operations 

Network Operations and Operations Support 
Mission Interface and Support 
TDA Program Management and Analysis 
GCF Implementation and Operations 
Data and Information Systems 

OSSA Tasks: 

Search for Extraterrestrial Intelligence 
Geodynamics 

Geodetic Instrument Development 
Geodynamic Science 


Discretionary Funded Tasks 
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Coupled Translations of the 64-Meter Antenna 
Subreflector Supports 

M. S. Katow 

Ground Antenna and Facilities Engineering Section 


The Tricone subreflector assembly of the 64-m diameter antenna is supported from 
the apex of the quadripod by six flexure rods. The subreflector can be translated in the 
three orthogonal axes by fackscrews at the ends of each rod. The arrangement of the six 
rods is described and analysis of the position errors introduced by coupled translations is 
presented. The results indicate that negligible RF gain losses caused by axis-coupled 
translations (less than 0.05 dB) are possible at X-band (8.45 GHz) operation. 


I. Introduction 

The existing subreflector of the 64-m antenna, employing 
the Tricone RF feed system, is supported from the quadripod 
apex by six rods, each with flexures at both ends as shown in 
Figs. 1 and 2. A jackscrew is located at one end of each rod. 
Three rods are used for the A -axis motion, two rods for the 
y-axis motion and one rod for the X-axis motion. The sub- 
reflector can be translated in the three orthogonal directions 
X, Y and Z by changes in the lengths of these rods by motor- 
ized jackscrews using worm gears. The RF feed cone-to-RF 
feed cone rotation of the subreflector is provided by a rota- 
tional drive mechanism. 

In the Tricone RF feed system, the sloped axis of the sub- 
reflector is rotated about the symmetric axis of the reflector 
to one of the three main RF feed positions A, B or C (Fig. 3). 

Because the reflective surfaces (the main reflector and the 
subreflector) are rigged or set at 45 degrees elevation angle, 
the rotation of the antenna to other elevation angles intro- 
duces more gravity loading distortions that result in RF phase 
center offsets at the paraboloid’s prime focus, which in turn 


produce RF gain losses. Accordingly, the subreflector can be 
translated with respect to its supporting quadripod by length 
changes of the supporting rods to minimize these offsets and 
reduce the antenna’s resulting RF gain losses. 

The arrangement of the six supporting rods results in a 
statically determinate type truss where a small length change 
of any rod produces a minimal change in the axial force. The 
use of flexures has minimized any moments or bending stresses 
in the rods. 

The geometrical arrangement of the subreflector support 
rods is described in this article together with the analysis and 
computation of the cross couplings of the corrective transla- 
tions and the resulting gain losses. The goal was to estimate 
how much the gain losses can be caused by these axis-coupling 
position errors. 

II. Analysis 

The coordinate system of the supporting rods was chosen 
parallel to the symmetric axis of the main reflector with the 
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angular difference of 4 deg and 31 min between the axis of the 
main reflector and the subreflector axis. In the isometric view 
of Fig. 4, the angles between the hyperboloid axis and the two 
planes parallel to the symmetric axis of the main reflector for 
the subreflector in position^ are shown. 

The subreflector is supported in the axial-Z direction by 
three flexure rods as shown in Figs. 1 and 2. These rods also 
constrain the rotational moments about the X and Y axes to 
account for three degrees of freedom. Three jackscrews driven 
in unison control the Z-axis translation. 

In the lateral- 7 direction, two rods driven in unison are 
used to account for the rotation constraint about the Z-axis 
as well as the Y translation. These two rods account for two 
more degrees of freedom. 

By arranging the design to connect the sliding anchor on 
the subreflector end of the AT-lateral constraint to the end of a 
7-lateral strut, as shown in Fig. 1, it was possible to eliminate 
the axis-coupled translations in the X-direction resulting from 
the large 7-lateral corrections. The gain loss due to the induced 
azimuth pointing (or boresight) error would not have satisfied 
operational requirements without correction. The X-lateral 
constraint adds to the six degrees required for stability. 

Starting with the subreflector aligned with the main reflec- 
tor’s symmetric axis at the 45 deg elevation angle, raising the 
64-m antenna to 84 deg elevation generates 7.62 cm (3.0 in.) 
lateral offset between the focus of the best fit paraboloid of 
the main reflector and the deflected virtual focus of the sub- 
reflector system. This lateral Y defocus can be continuously 
corrected by jackscrews adjusting the lengths of the Y lateral 
rods through the change in the elevation angles. The cross- 
coupled axial Z defocus resulting from the lateral Y correc- 
tions is described in Fig. 5 and defined in Table 1. 

During the elevation angle change, axial Z defocus also 
occurs. From the set 45-deg position, an axial Z defocus of 
+0.76 cm occurs close to 80-deg elevation angle and of -2.03 cm 


at 10-deg elevation angle, as changes from the 45-deg elevation 
angle. 

When the axial Z defocus is corrected by the jackscrews on 
the Z axial rods, four coupled sources of gain losses are gener- 
ated. Figure 6 shows the lateral cross-coupled defocus in the 
7-direction (view-AA) and in the X direction (view-BB) 
defining two of the sources of gain losses with calculated 
lateral offsets in Table 2. The third lateral offset occurs 
because the axis of the subreflector is tilted 4 deg and 31 min 
to the axial Z motion. Figure 7 describes the lateral offsets 
from this source with the numerical offsets shown in Table 3. 

The vector sum of the lateral offsets of Tables 2 and 3 are 
added and shown in Table 4 for the three basic RF feed cone 
positions only for the maximum -2.03 cm Z focus position. 

The subreflector’s lateral offsets can be redefined as the 
offsets of the vertex, and the lateral defocus of Fig. 9 can be 
calculated. This defocus results in a gain loss as calculated in 
Fig. 8. The gain loss calculations of Fig. 8 are described in 
Ref. 1. Additional gain loss occurs due to boresight errors as 
shown in Fig. 9. This loss should be added to the gain loss 
described in Table 4. 

III. Summary 

The existing six supporting rods of the subreflector assem- 
bly generate axis-coupled translations which, when combined 
with the translations required to correct the phase centers 
offsets, result in less than 0.05 dB RF gain loss at X-band 
(8.45 GHz). 

For a higher RF frequency operation the corrective trans- 
lations will be significant and should be added to the new 
microprocessor now used to control the subreflector. New 
subreflector rotations about the X and Y axes can also be 
superimposed, if required later on, by adding differential gear 
boxes to the shafts between the jackscrews driving the three 
Z-axis supporting rods. 


Reference 

1. Katow, M. S. “34-Meter Antenna-Subreflector Translations to Maximize RF Gain,” 
TDA Progress Report 42-62 , Jan. and Feb. 1981, pp. 112-120. 
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Table 1. Gain loss from Z-axis defocus resulting from lateral- Y motion 
(see Fig. 5, cone positions A , B, or C) 


Sequence 

r-Offset 
(YOF), 
cm (in.) 

Angle 

(a), 

deg a 

A , 

cm (in.) b 

B 

Defocus, 
cm (in.) c 

Gain 

Loss, 

dB d 

.1 

2.54 

0.4668 

311.78 

0.01 

<0.0001 


(1.00) 


(122.748) 

(0.004) 


2 

5.08 

0.9336 

311.75 

0,04 

0.0004 


(2.00) 


(122.736) 

(0.016) 


3 

7.62 

1.4004 

311.70 

0.09 

0.0023 


(3.00) 


(122.715) 

(0.035) 


4 

10.16 

1.8674 

311.62 

0.17 

0.0079 


(4.00) 


(122.687) 

(0.067) 



a a = sin -1 (YOF/31 1.79) 


b A = vfoll.79) 2 + (YOF) 2 
C B = 311.79 -A 
d See Fig. 8 


Table 2. Lateral X (Fig. 6, view BB) or Y (Fig. 6, view AA) travel cross-coupled to ±Z axial 
focus motion for cone positions A, B, or C 


Axial-Z 
Focus Motion, 
cm (in.) 

H y cm (in.) 3 

/, cm (in.) b 

Jy cm (in.) c 

K , cm (in.) d 


+0.76 

253.371 

+0.0010 

251.4589 

+0.0011 


(+0.3) 

(99.752) 

(+0.0004) 

(99.000) 

(+0.0004) 


-2.03 

253.362 

+0.0080 

251.4518 

+0.0082 


(-0.8) 

(99.749) 

(+0.0032) 

(98.9968) 

(+0.0032) 


= V253.370 2 

-z 2 




b 7 

= 253.370 -77 




C J 

= V^51.460 2 

-Z 2 




*K 

= 251.460 -1 
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Table 3. Lateral X and Y offsets for ±Z axial focus motions. Angular offset to subreflector 
axis is 4 deg. 31 min. (See Fig. 7 for lateral V offset and lateral X offset.) 


Cone Position 

A t B 

A 

B 

c 

Axial-Z 

Focus Motion, 

L, cm (in.) a 

M y cm (in.) b 

N, cm (in.) c 

Py cm (in.) d 

cm (in.) 

+0.76 

0.030 

-0.052 

0.052 

0.060 

(+0.3) 

(0.012) 

(-0.020) 

(0.020) 

(0.236) 

-2.03 

-0.080 

0.139 

-0.139 

0.060 

(-0.8) 

(0.031) 

(0.055) 

(-0.055) 

(-0.063) 


a L 

b M 

C N 

dp 


0.76 tan (2.2566); L 
0.76 tan (3.9106); M 
0.76 tan (3.9106); N 
0.76 tan (4.5167); P 


= 2.03 tan (2.2566) 
= 2.03 tan (3.9106) 
= 2.03 tan (3.9106) 
= 2.03 tan (4.5167) 


Table 4. X-band (8.45 GHz) gain loss from cross-coupled lateral and boresight error 
for -2.03 cm Z focus (see Figs. 7 and 9) 


Parameter 


Cone Position 



A 

B 

C 

Lateral-K Travel, cm 

I = +0.008 

I = +0.001 

/ » +0.001 

Lateral-X Travel, cm 

K = +0.008 

K = +0.008 

K = +0.008 

Lateral- Y Offset, cm 

L = -0.080 

L = -0.080 

P = -0.160 

Lateral-X Offset, cm 

M = 0.139 

N = -0.139 

0 

Subreflector Vertex 
Vector Sum Offset, cm 

0.164 

0.153 

0.159 

Lateral Defocus, cm 

0.130 

0.122 

0.126 

Lateral Defocus 
Gain Loss, dB 

-0.00022 

-0.00019 

-0.00021 

Boresight Error, deg 

0.0023 

0.0022 

0.0023 

Boresight Error 
Gain Loss, dB 

-0.049 

-0.045 

-0.049 

Total Gain Loss, dB 

-0.0492 

-0.0452 

-0.0491 


4 





Fig. 1. Flexure supports for the 64-m antenna subreflector 
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I QUADRIPOD 
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X JACKSCREW MOUNTED 
ON QUADRIPOD 


Fig. 2. Isometric view of the 64-m subreflector supports 





Fig. 3. The 64-m Tricone subreflector geometry 



Fig. 4. The 64-m subreflector axis orientation positions 



Fig. 5. The 64-m subreflector axial-Z defocus resulting from 
lateral-Y motion or offset 
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Fig. 6. The 64-m subreflector X and Y Support Rods. The X and y lateral defocus is 
cross-coupled from axIs-Z motion. 
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Fig. 7. The 64-m subreflector X and Y lateral offset from axial-Z focus motions 
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Fig. 8. The 64-m antenna ( F/D = 0.4235) gain loss vs axial and lateral defocus 
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Fig. 9. The 64-m antenna boresight error from subreflector lateral shift 



Fig. 10. The 64-m antenna gain loss vs boresight errors. Uniform 
amplitude illumination assumed. 
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Seismic Analysis of the Large 70 -Meter Antenna, 
Part II: General Dynamic Response 
and a Seismic Safety Check 

K. Kiedron and C. T. Chian 
Ground Antennas and Facilities Engineering Section 


An extensive dynamic analysis for the new JPL 70-meter antenna structure is presented. 
Analytical procedures are based on the normal mode decomposition , which include damp- 
ing and special forcing Junctions. The dynamic response can be obtained for any arbi- 
trarily selected point on the structure. 

A new computer program for computing the time-dependent ; resultant structural dis- 
placement t, summing the effects of all participating modes , was developed also. Program 
compatibility with natural frequency analysis output was verified. The program was 
applied to the JPL 70-meter antenna structure and the dynamic response for several 
specially selected points was computed. 

Seismic analysis of structures, a special application of the general dynamic analysis , 
is based also on the normal modal decomposition. Strength specification of the antenna, 
with respect to the earthquake excitation , is done by using the common response spectra. 
The results indicated basically a safe design under an assumed 5% or more damping coeffi- 
cient. However, for the antenna located at Goldstone, with more active seismic environ- 
ment, this study strongly recommends an experimental program that determines the true 
damping coefficient for a more reliable safety check. 


I. Introduction 

The development of a general dynamic analysis for an RF 
antenna which leads to a better understanding of the full 
range of pointing error sources is important from the point of 
view of evaluating the antenna performance and preparing it 
for higher frequency operation. Normal modal decomposition 
is suitable for an antenna structure represented by a finite ele- 


ment model with multi-thousand degrees of freedom. The 
theoretical background of such an approach is given in Refs. 1, 
2, 3, 4. The primary purpose of this study was to get the time 
history of the dynamic response of the antenna subject to 
different forcing functions. Another important task was 
related to the upgrading and rehabilitation of the present JPL 
64-/70-meter antenna to ensure that the antenna structure 
design satisfies the local earthquake safety criteria. Because 


seismic analysis is also based on normal modal decomposition, 
the dynamic analysis was treated more generally and expanded 
to give the general dynamic response. 

The seismicity map of the world shown in Fig. 1 illustrates 
the strong epicenter locations as obtained from different 
U.S.A. and foreign seismological stations. In particular, the 
West Mediterranean area is of interest to the JPL antenna 
located in Madrid (Spain). Southeastern Australia is important 
for the antenna located in Canberra, and the southwestern 
U.S.A. for the antenna located at Goldstone, California. 
Fig. 1 together with a previous study 1 have indicated that the 
seismicity of the overseas JPL stations in Spain and Australia 
do not pose serious problems. However, the Goldstone antenna 
is subjected occasionally to substantial seismic activity and 
hence, requires a careful consideration of earthquake-induced 
loads. 

The method of seismic analysis based on normal modal 
analysis was presented earlier in Ref. 5. However, for most 
engineering design safety purposes the simplified approach 
based on the design response spectra is usually adequate. The 
approach describes the structure earthquake characteristics 
in a statistical manner, encompassing a number of earthquake 
motions appropriately selected to the given excitation magni- 
tude and the distance of object from the center of earthquake. 
The specification of the structure strength can be evaluated 
on a statistical basis. 

II. Governing Equations 

The dynamic equations of motion for a multi-degree of 
freedom system subjected to a ground forcing function can 
be summarized from Part I of the study (Ref. 5) as: 

[M] {y} + [C] {y} + [K] 00 =- [M] {a} (1) 

where [M ] , [C], [K] are mass, damping and stiffness matri- 
ces, respectively, {j>} is the displacement vector relative to the 
ground displacement of modal mass and { 0 } is the horizontal 
component of ground acceleration. 

Equation (1) represents a system of N linear differential 
equations of second order which are transformed into a set of 
N uncoupled equations in normal coordinates, (z). The mode 
equation is written as: 


1 “Antenna (210 ft) Facilities in Southeast Australia and Southern 

Europe,” JPL Preliminary Engineering Report, Vol. 3 and 4 (internal 
document), JPL Contract No. 951281 with Holms and Narver, Inc., 
Jet Propulsion Laboratory, Pasadena, Calif., August 1965. 


* r + 2 $, c o r z r + u 2 = a. a(r) (2) 

where co r , are the natural circular frequency and damping 
ratio, respectively and a r is the rth modal participation factor, 
which determines to what extent each mode participates in the 
final response. The solution of Eq. (2) is given by: 

a r S 

z r = 7T I a W ex P F$ r w r - T )] sin C 0 r (t - t) dr 
r J o 

( 3 ) 

where r is the time variable for Duhamel integral. 

The resultant relative nodal displacements, after determin- 
ing z r are computed by: 

w = £ o '„>{*,}-[*,]{*} (4) 

r-\ 

where y or is the rth eigenvector and N is the number of 
modes. Any numerical integration of Eq. (3) can be employed. 
When it is desirable to know more precisely what the actual 
structure dynamic response will be, the complete dynamic 
analysis of the structure is performed. This requires the knowl- 
edge of the natural frequencies co, the eigenvectors and the 
weighting or participation factors. The participation factors 
are obtained from the antenna eigenvalue analysis program. 

A simplified approximate approach, adequate for common 
design purposes can be performed too where the upper bound 
of the response spectra is estimated. Such approximate analy- 
sis, based on ground-motion response spectra is an attractive 
alternative which avoids a major computation task of numeri- 
cal integration of the coupled Eq. (1) or their transformation 
to a system of normal (modal) coordinates. Various earth- 
quake motion responses for a single degree-of-freedom system, 
represented by Eq. (2), have been evaluated (Ref. 2) and are 
used in the form of design response spectra, as shown in 
Fig. 2. 

III. Antenna Finite-Element Model 

The 70-m antenna-structure components are shown in 
Fig. 3. For an economical processing on the UNIVAC 1 100/81 
computer, only half of the structure was modeled. The Y-Z 
plane is a plane of symmetry and the Z-axis is the focal axis as 
in Fig. 4. The Z-axis is the axis of the reflector elevation rota- 
tion. The finite element model of only half of the structure 
contains about 2000 nodes, 7000 finite element members and 
6000 degrees of freedom (Ref. 6). The JPL IDEAS structure 
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analysis computer program was used for performing the eigen- 
value analysis. In order to obtain a good convergence between 
the multi-thousand degree of freedom finite element model of 
the antenna and its condensed representation to suit the 
dynamic analysis, two methods were applied: the inverse 
power (Stodola Method) and the Subspace-Iteration method. 

Although the natural frequency (eigenvalue) analysis of the 
antenna structure does not require the presence of any exter- 
nal loading, the approach employed in this study was to make 
use of two antenna loading decompositions. These two loading 
decompositions were made possible in general to include the 
arbitrarily oriented acceleration vector in a 3-D space. 

To illustrate the two loading deflection decompositions 
further, Figs. 5(a) and 5(b) give a general geometrically sym- 
metrical antenna structure with asymmetric loading. By 
resolving the loading (forces or moments) as shown in Fig. 5(a) 
into two decompositions, the loading in decomposition 2 is 
antisymmetrical (equal but directionally opposite forces). In 
each loading decomposition pattern, only half the antenna 
structure is modeled and different boundary conditions are 
applied in each case which affect the stiffness matrix [K] 
and may generate different eigenvalues (frequencies). Gen- 
erally, in order to obtain the whole antenna response, super- 
position of the two decompositions of the half-antenna 
models is necessary. Ten modes for each of the two decompo- 
sitions were obtained as in Table 1 together with participation 
factors. In our study only loading decomposition 2 was chosen 
since it resulted in larger participation factors relative to 
decomposition 1. 

It is also chosen because it closely represents a no-external- 
load situation when the antenna is at zenith position and 
under gravity loading. Furthermore, a complete eigenvector 
analysis was made at decomposition 2, and the results are 
listed in Table 2 for Five selected points on the antenna as 
shown in Fig. 4. 

IV. Design Response Spectra 

The specification of the strength of 64-meter antenna 
located at Goldstone, with respect to the appropriate earth- 
quake loading, has been based on the site design response 
spectra, as shown in Fig. 2. In fact, the same method was 
proposed by Prof. G. W. Housner of Caltech in 1959, recom- 
mended by U.S. Atomic Commission in 1963, and was 
employed in checking the 64-m antenna in 1964. The new 
70-m antenna structure is characterized by twenty, closely 
spaced, natural frequencies, which are computed from struc- 
ture programs and listed in Table 1. For design convenience, 
three different damping ratios (2, 5 and 10%) were selected 
and the response spectra for each mode were obtained and 


plotted in Fig. 6. The dotted band in Fig. 6 indicates the 
safety margin given by Prof. Housner circa 1960 for the 64-m 
antenna which ranges between 0.25 g and 0.35 g. 

Figure 6 indicates also that viscous damping coefficients 
play an important role in determining the structure safety. 
Prior seismic analysis work has not provided the true damp- 
ing coefficients of the antenna because of air resistance or 
bearing friction. If the coefficient was to be greater than 
5%, then the safety margin previously used circa 1960 is suit- 
able. If the damping coefficient obtained from a future experi- 
ment is to be less than 5%, then the safety margin should be 
increased for a safer design. 

V. Results of General Dynamic Analysis 

Five points, A, B y C, D and E , for the whole antenna 
structure were selected as representative from the dynamic 
point of view shown in Fig. 4. A FORTRAN program TRANS- 
IENT was developed to perform the operations represented by 
Eq. (4), which give the time-dependent resultant nodal dis- 
placements, compounded from all participating modes. The 
values of natural frequencies, eigenvectors and participation 
factors were taken from the JPL IDEAS eigenvalue analysis 
program. These are listed in Tables 1 and 2. With the El Centro 
(1940) earthquake excitation (shown in Fig. 7) as a sample 
forcing input, the results of Five time-dependent responses, 
each for a particular point on the antenna structure, are pre- 
sented in Figs. 8, through 12, respectively. The 5% damping 
ratio was taken as a computational parameter. 

The maximum displacements were determined at Five 
antenna points for illustration. The comparison of the five 
peak displacements is shown in Fig. 13. Point A (top of the 
apex) has the largest displacements (1 1 cm) due to the more 
flexible quadripod supports compared to the back-up reflec- 
tor structure. Point B f at the rim of the reflector, has a maxi- 
mum displacement of 2 cm. Point C (bottom of the reflector, 
dish) and Point D (elevation drive gear) have similar maximum 
displacements (8 mm and 7 mm, respectively). Point E (at the 
bottom of the alidade) experiences the smallest peak displace- 
ments of 2 mm. The results show that the level of the maxi- 
mum displacements is not excessive. 


VI. Summary 

A new dynamic technique for computing the time-dependent 
multi-mode resultant displacement of a large structure was 
developed. This new tool, which includes damping and special 
forcing functions, is important in solving many engineering 
problems, such as those dealing with structure dynamics under 
nonsteady wind loading, control system design and pointing 
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error analyses. The seismic analysis of the antenna structure 
was performed as a special application of this general dynamic 
technique and shows, according to the obliging seismic criteria, 
basically a safe design. 

In the past it was recommended that the 64-m antenna 
structure be designed to withstand an equivalent, constant, 
lateral acceleration of 25% G for good earthquake resistance. 


Those early seismic analyses were based on rough estimates of 
the fundamental mode frequency. With the first 20 natural 
frequencies obtained from this mathematical model for the 
70-m antenna, more extensive dynamic studies can be per- 
formed in general and on seismic responses in particular. Our 
seismic study results suggest an experimental program that 
determines the true damping coefficients for a more reliable 
safety check. 
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Table 1. Antenna dynamic characteristics 


Mode 

No. 


Circular 
Frequency (gj), 
Radian/s 


Frequency 
if), Hz 


Participation 
Factors (a) 


Decomposition 1 


1 

9.99 

1.59 

-0.056 

2 

16.64 

2.65 

0.156 

3 

17.20 

2.74 

1.213 

4 

21.15 

3.37 

-1.410 

5 

21.29 

3.39 

1.379 

6 

22.73 

3.62 

1.059 

7 

23.52 

3.74 

-0.153 

8 

24.40 

3.88 

0.281 

9 

25.37 

4.04 

0.885 

10 

26.16 

4.16 

-0.154 


Decomposition 2 


1 

7.89 

1.26 

2.703 

2 

8.61 

1.37 

-1.518 

3 

10.13 

1.61 

3.280 

4 

13.39 

2.13 

-3.732 

5 

16.68 

2.65 

0.333 

6 

18.13 

2.88 

3.287 

7 

18.43 

2.93 

-0.443 

8 

18.70 

2.98 

-0.340 

9 

19.13 

3.04 

2.301 

10 

19.60 

3.12 

0.033 


Table 2. Values of eigenvectors for decomposition 2 

Mode 

No. 


Node Identification 


A 

B 

C 

D 

E 

1 

0.693 

0.103 

0.066 

0.058 

0.012 

2 

0.598 

-0.020 

-0.015 

-0.013 

-0.003 

3 

0.460 

-0.068 

0.018 

0.014 

-0.004 

4 

0.395 

-0.236 

-0.108 

-0.082 

-0.002 

5 

0.067 

-0.187 

0.006 

-0.011 

0.013 

6 

-0.096 

-0.023 

0.023 

0.017 

0.005 

7 

-0.104 

0.030 

-0.005 

-0.003 

-0.003 

8 

-0.014 

0.043 

-0.009 

0.000 

0.001 

9 

0.108 

-0.117 

0.053 

0.036 

0.013 

10 

0.071 

0.010 

0.000 

0.000 

-0.001 




Fig. 1. Seismicity map of the world (from Ref. 2, p. 23) 
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Fig. 2. Design response spectra 
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Fig. 3. Antenna components 







z 



20 



(a) 


PLANE OF SYMMETRY 


(b) 


PLANE OF SYMMETRY 


GENERAL 
LOADING 
PARALLEL TO 
PLANE OF 
SYMMETRY 

( R 1 * P 2 > 



GENERAL 
LOADING 
NORMAL TO 
PLANE OF 
SYMMETRY 
(P 3 - P 4 > 




ANTI-SYMMETRIC LOADING MODEL 


SYMMETRIC LOADING MODEL 





HALF STRUCTURAL MODEL WITH 
APPROPRIATE BOUNDARY CONDITIONS 


HALF STRUCTURAL MODEL WITH 
APPROPRIATE BOUNDARY CONDITIONS 




Fig. 5. Load decomposition on a symmetric antenna 



IT INPUT, mr 









DISPLACEMENT RESPONSE 



















July-September 1985 


2>3- JJ_ 


TDA Progress Report 42-83 


In Search of a 2-dB Coding Gain 

J. H. Yuen and Q. D. Vo 
Communications Systems Research Section 


A recent code search found a ( 15, 1/5), a ( 14, 1/6 ), and a (15, 1/6) convolutional code 
which , when concatenated with a 10-bit (1023, 959) Reed-Solomon (RS) code, achieves a 
bit-error rate (BER) of 10~ 6 at a big signal-to-noise ratio (SNR) of 0,50 dB, 0.47 dB and 
0.42 dB, respectively. All of these three codes outperform the Voyager communication 
system, our baseline, which achieves a BER of 10~ 6 at bit SNR of 2.53 dB, by more than 
2 dB. Our 2 dB coding improvement goal has been exceeded. 


I. Introduction 

To enable future planetary missions to provide today’s 
equivalent or better information return, higher communica- 
tion efficiencies have to be achieved. More efficient communi- 
cation links will help to lower mission cost. 

To achieve reliable communications over a noisy channel 
with acceptable coding complexity, concatenated coding sys- 
tems with a convolutional code as the inner code and a Reed- 
Solomon (RS) code as the outer code are used. NASA’s Voy- 
ager employs a communication system which uses a (7, 1/2) 
convolutional code as its inner code and an 8-bit (255, 223) 
RS code as its outer code. This system, which achieves a bit- 
error rate (BER) of 10 -6 at a bit signal-to-noise ratio (SNR) of 
2.53 dB, is the proposed NASA standard and our baseline. 
Communication system performance can be improved by 
many means, including increasing the spacecraft transmitter 
power, the antenna size, and the coding complexity. 

Spacecraft transmitter power is at a premium; larger an- 
tennas are also very costly. Fortunately, with the continued 
progress in VLSI technology, it is possible to implement codes 
with much higher complexity than our baseline system. Our 


goal in this search was to find codes which will provide a 2 dB 
improvement over the baseline system, i.e., the new code 
needs to achieve a BER of 10 -6 at a bit SNR of 0.53 dB. This 
2 dB gain of bit SNR by coding improvement is likely to be a 
much more cost effective means than increasing spacecraft 
transmitter power, antenna size, etc. 

II. Code Search Results 

Instead of using the criterion of maximum free distance, 
df, we searched for good convolutional codes using the crite- 
rion of minimizing required bit SNR, E b /N 0 , for a given value 
of desired BER, for the goodness of code. The channel consid- 
ered is the deep space channel which is the additive white 
Gaussian noise channel and binary-phase-shift-keying (BPSK) 
modulation (Ref. 1). Partial results for good convolutional 
codes of constraint length K < 13, and rate 1 /N, 2 < N < 8, 
have been reported (Refs. 2 and 3). For ( K , 1/AO convolu- 
tional codes, the number of all possible codes is 2 KN , which is 
extremely large for large K and N. It is prohibitively time 
consuming to perform an exhaustive search except for small K 
and N. Using educated guesses combined with the idea that 
good codes generate good codes (Ref. 2), we performed selec- 
tive searches for good low rate 1 jN convolutional codes of 
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constraint length AT = 13, 14, and 15. The codes found were 
first measured by using the free distance and then the transfer 
function bound (Ref. 3), which is a fast, efficient algorithm 
developed for our code search effort. Relatively good code 
resulted. The symbol-error probabilities were determined by 
computer simulations using 4-bit channel output quantization, 
and the performance of these relatively good convolutional 
codes when concatenated with various RS codes was deter- 
mined. 

The convolutional code generators (in Octal) for several 
relatively good codes of rate 1/4, 1/5, and 1/6 are listed in 
Table 1, 2, and 3, respectively. The minimum free distances 
of these codes are also listed. The 10-bit symbol error prob- 
abilities, obtained by long computer simulations, are plotted 
in Fig. 1 for some of these codes (codes marked with an 
asterisk (*) in Tables 1, 2, and 3). These convolutional codes 
are concatenated with various 10-bit RS codes. The required 
E b /N 0 (i.e., outer code SNR) to achieve a BER of 10“ 6 is 
determined (Ref. 5) and shown in Table 4 for concatenated 
systems with optimal RS code rates. 

Similarly, performance results have also been obtained 
when these convolutional codes are concatenated with various 
8-bit RS codes, including the (255, 223) RS code of our 
baseline system. Results are included in Table 4. It is found 
that the performance of the 8-bit RS code is only about 
0.25 dB less than the 10-bit RS code. 

We have found three convolutional codes which, when con- 
catenated with the 10-bit (1023, 959) RS code, exceed our 
2 dB coding improvement goal. These are the (15, 1/5), 
(14, 1/6), and (15, 1/6) convolutional codes whose code 
generators are given in Tables 2 and 3. The performance of 
these codes is also illustrated in Fig. 2 along with some his- 
torically significant codes used for deep space communica- 
tions. 


Our 2 dB coding gain in SNR comes from increased decoder 
complexity and expanded bandwidth. Since implementation 
complexity may be an issue, let us examine the complexity of 
these codes. The encoders are relatively simple. For example, 
the best convolutional code (15, 1/6) that we have found is 
only slightly more complicated that the current Voyager base- 
line (7, 1/2) convolutional code as depicted in Fig. 3. They are 
indeed simple logic circuits. An assessment of the increased 
decoder complexity and expanded bandwidth of the two most 
powerful codes that we have found is summarized in Table 5 
by comparing them to our baseline system. Replacing the 8-bit 
RS code in our baseline system by the 10-bit RS code contri- 
butes only about 0.25 dB in coding gain, but the increase in 
decoder complexity is rather large. Since most of the coding 
gain comes from the long constraint length, low rate convolu- 
tional codes, we should concentrate on their implementation. 
We feel that the realization of our newly found good convolu- 
tional codes is within reach by VLSI technology. 


III. Conclusion 

Our selected search of the astronomical number of possible 
convolutional codes of constraint length K = 13, 14, and 15, 
and rate 1/2 to 1/6 was guided by educated guesses and the 
idea that good codes generate good codes. We used the prac- 
tical criterion of minimizing the required bit SNR for a given 
BER for the goodness of code. By using a specially developed 
fast efficient transfer function bound algorithm and computer 
simulation programs, we obtained many good convolutional 
codes. In particular, we found a (15, 1/5), a (14, 1/6), and a 
(15, 1/6) convolutional code. Each, when concatenated with a 
10 bit (1023,959) RS code, outperforms our baseline system 
by 2.03 dB, 2.06 dB, and 2.11 dB respectively. They exceed 
the 2 dB coding improvement goal. Considerations have been 
given to the decoding complexity. We feel that VLSI technol- 
ogy will enable the realization of our newly found convolu- 
tional codes. 
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Table 1. Rate 1/4 convolutional codes 


K 


Generators (Octal) 


^free 

13 

11145 

12477 

15573 

16727 

33*t 

14 

20553 

25271 

33447 

37515 

34 


21113 

23175 

35557 

36527 

36 

15 

46321 

51271 

63667 

73257 

37 


46321 

51271 

63667 

73277 

38 


tThis code was found by Larsen (Ref. 4). 


Table 2. Rate 1/5 convolutional codes 


K 



Generators (Octal) 



^free 

13 

10661 

11145 

12477 

15573 

16727 

41* 


10671 

11145 

12477 

15573 

16727 

42 

14 

21113 

23175 

27621 

35557 

36527 

44* 

15 

46321 

51271 

63667 

70535 

73277 

47 


46321 

51271 

63667 

70565 

73277 

47* 


Table 3. Rate 1/6 convolutional codes 


K 



Generators (Octal) 



^free 

14 

21113 

23175 

27621 

33465 

35557 

36527 

53* 


21113 

23175 

27631 

33465 

35557 

36527 

54 

15 

46321 

51271 

70535 

63667 

73277 

76513 

56* 



Table 4. Required E^Nq to achieve a BER of 10“ 6 


Inner 

Convolutional 

Codes 

Outer 
RS Codes 

Required E^/Nq 
for P b = 10-6, dB 

Improvement Over 
Baseline System, dB 

(13, 1/4) 

(1023, 895) 

0.84 

1.69 

(13, 1/5) 

(1023,927) 

0.68 

1.85 

(14, 1/5) 

(1023, 927) 

0.57 

1.96 

(15, 1/5) 

(1023,959) 

0.50 

2.03 

(14, 1/6) 

(1023,959) 

0.47 

2.06 

(15, 1/6) 

(1023,959) 

0.42 

2.11 

(13, 1/5) 

( 255,223) 

0.93 

1.60 


( 255,229) 

0.91 

1.62 

(14, 1/5) 

( 255,223) 

0.82 

1.71 


( 255,231) 

0.79 

1.74 

(14,1/6) 

( 255,223) 

0.71 

1.82 


( 255, 233) 

0.63 

1.90 
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Table 5. Decoder complexity considerations 




New Code No. 1 

New Code No. 2 

New Code No. 3 

Performance 

Parameter 

Voyager’s Code 
(7,1/2) + 
(1023,959) RS 

(15,1/5) + 
(1023, 959) RS 

Adv./Disadv. 
Relative to 
Voyager’s Code 

(14,1/6) + 
(1023,959) RS 

Adv./Disadv. 

Relative to 
Voyager’s Code 

(15,1/6) + 
(1023, 959) RS 

Adv./Disadv. 
Relative to 
Voyager’s Code 

SNR Required 
for BER = 10 -6 

2.53 dB 

0.50 dB 

2.03 dB 
Improvement 

0.47 dB 

2.06 dB 
Improvement 

0.42 dB 

2.11 dB 
Improvement 

Inner Code 

Memory 

64 States 

16384 States 

256 Times 

8192 States 

128 Times 

16384 States 

256 Times 

Computations 

1 (Normalized) 

640 (Normalized) 

640 Times 

384 (Normalized) 

384 Times 

768 (Normalized) 

768 Times 

Outer Code 

Memory 

255 X 8 

1023 X 10 

5 Times 

1023 X 10 

5 Times 

1023 X 10 

5 Times 

Computations 

1 (Normalized) 

20 (Normalized) 

20 Times 

20 (Normalized) 

20 Times 

20 (Normalized) 

20 Times 

Overall 

Bandwidth 

Expansion 

2.2 

5.3 

2.5 Times 

6.4 

2.9 Times 

6.4 

2.9 Times 



INNER CONVOLUTIONAL CODE SNR (E b /N Q ), dB 


Fig. 1. Simulated 10-bit symbol error probability 




BIT ERROR PROBABILITY 



< ] )(7, 1/2) CONVOLUTIONAL CODE (VITERBI DECODING) CONCATENATED WITH A 
(255, 223) REED-SOLOMON OUTER CODE 

INFINITE BANDWIDTH EXPANSION 

(3) CONCATENATED WITH A (1023, 95?) REED-SOLOMON CODE 

O THEORETICAL LIMIT FOR RATE 1/5 CODES IS -1 .01 dB AND FOR 
RATE 1/6 CODES IS -1.10 dB 


Fig. 2. Deep space telemetry performance 


PRESENTLY USED (7, 1/2) CONVOLUTIONAL ENCODER ON VOYAGER 



NEWLY FOUND (15, 1/6) CONVOLUTIONAL ENCODER 
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Decoding Convolutionally Encoded Images 

G. H. Pitt, 111, and L. Swanson 
Communications Systems Research Section 


Maximum Likelihood Convolutional Decoding , which is used by the Deep Space 
Network for short constraint-length convolutional codes , assumes that all strings of 
information bits are equally likely. In some cases, like image data, this is not the case. We 
examine the use of information about an adjacent pixel in decoding convolutionally 
encoded Voyager images, and discover that, in a region of interest, as much as 2 dB may 
be gained. 


From the standpoint of digital data, the coding system for 
Voyager (and an international coding standard) consists of a 
Reed-Solomon encoder (optional), a convolutional encoder, a 
noisy channel, a maximum likelihood convolutional decoder 
(Viterbi decoder), and, if necessary, a Reed-Solomon decoder 
(see Fig. 1 ). With bit signal-to-noise ratio (SNR) as low as 
2.3 dB, the concatenated scheme produces a bit error rate of 
10~ 5 , and the convolutionally coded only scheme produces a 
bit error rate of 3 X 10“ 3 , while an uncoded scheme produces 
a bit error rate of 3 X 10“ 2 at this signal-to-noise ratio. 

The Viterbi decoder finds the codeword which is closest to 
the received string. This is called maximum likelihood decod- 
ing because, under the assumption that all codewords are 
a priori equally likely to be transmitted, this decoding scheme 
retrieves the most likely sent codeword. In some cases, though, 
codewords are not all equally likely to be transmitted. In 
Voyager images, for example, pixel to pixel variations are not 
completely random: They are much more likely to be small 
than large. In this case, a decoder which makes use of the 
source statistics should perform better than a Viterbi decoder. 
(Image compression uses these statistics to lower the transmis- 
sion rate and thus raise symbol SNR, but some Voyager 


images are sent uncompressed because of spacecraft limita- 
tions; also, an alternative would be valuable in the unlikely 
event of a data compressor failure before Neptune encounter 
in 1989.) 

In Ref. 1, Korwar investigates the use of source statistics 
in convolutional decoding hard-quantized images, i.e., images 
in which each pixel is represented by one bit. Using hypo- 
thetical data, she found that using source statistics makes 
substantial improvement in decoder performance. Our work is 
different in two ways: We use 8-bit quantized pixels and real 
Voyager imaging data. Using 8-bit quantized pixels requires 
a byte-oriented rather than a bit-oriented decoder, which is 
more complicated and runs much more slowly. 

We obtained a tape of image data from Voyager project. 
It consisted of several pictures, each 800 by 800 8-bit quan- 
tized pixels. A C -language program was written on a VAX 
running UNIX to extract the frequency of various absolute 
differences in value between adjacent pixels. That is, thinking 
of each pixel as an integer X. between 0 and 255, the values of 
\X t - X i _ l | were tabulated. We were not surprised to discover 
that small values for this difference were much more common 
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than would be expected in random (independent) data (see 
Fig. 3). 

With the frequencies of \X i - X l _ 1 | obtained from one 
picture, a new decoder based on thse statistics was written, 
again using the UNIX VAX (see Appendix A for the algo- 
rithm). Another picture was then convolutionally encoded, 
Gaussian noise was added, and the picture was decoded with 
the new decoder. The performance of this decoder on this 
picture is shown in Figs. 4 and 5. These figures show that 
performance improves substantially for signal-to-noise ratios 
below 2.0 dB. This is a region of interest for images which 
have been Reed-Solomon encoded. (Byte error rates are shown 
in Fig. 5 because this is of interest for data which is Reed- 
Solomon encoded.) 

The curves show that our decoder does not perform as well 
as a conventional Viterbi decoder for signal-to-noise ratios 
much above 2.0 dB. At least part of this can be attributed to 
the edges of pictures, which our tape shows as dark on one 
edge and white on the other. These strips may be the result of 


data compression, in which case they would not occur in 
images being sent uncompressed (the only kind of images for 
which the new decoder is useful). Our lower performance may 
also be partly a result of “rizzomarks” which are added for 
calibration and whose effects could be discounted in a scheme 
like ours. 

We have not yet examined other possible schemes, such as 
considering both the pixel to the left of the current pixel 
(which the new decoder uses) and the pixel above it. Such a 
slightly more complicated scheme may slightly improve perfor- 
mance at the cost of slightly slower decoding. Using a software 
decoder on a VAX 750, decoding is very slow (640,000 bytes/ 
month); if our scheme were to be used for real transmitted 
data, we would need big gains from hardware and algorithm 
improvements. 

During Voyager’s Uranus encounter, some undecoded chan- 
nel symbols may be saved for the symbol stream combining 
experiment. We hope to use these to test our decoder under 
“real life” conditions. 
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BYTE-ORIENTED 



Fig. 1. Digital data coding scheme 



BIT-ORIENTED 



Fig. 2. An illustration of the difference in complexity of a byte- 
oriented decoder vs a bit-oriented decoder for 3-bit bytes and a 
constraint length 3 code 



Fig. 3. A graph of the observed frequency of different values of | X i - Xj_ A | for several Voyager 
images compared with the predicted frequency assuming independence (randomness) between 
adjacent pixels 
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Fig. 4. A graph of bit error rates for the conventional (old) and the 
modified (new) maximum likelihood decoder 



Fig. 5. A graph of byte error rates for the conventional (old) and the 
modified (new) maximum likelihood decoder 
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Appendix 


We assume that symbols ±1 are transmitted over an inde- 
pendent Gaussian channel. That is, if C = (c x , c 2 , • * • , c m ) is 
transmitted, then R - ,r 2 , • • • ,r m ) is received with prob- 

ability density 


which is the same as minimizing 

m 

E (r,.-c.) 2 -2a 2 log(P(C)) (A-5) 

1 = 1 


P(R\C) = -Lr — fi exp[-(r -c) 2 /2a 2 ] 

(oV2^) m 


(A-l) 


where a 2 = \I[2(E S /N 0 )] and E s /N 0 is the symbol signal - 
to-noise ratio. 


since nothing else depends on C. 

As the signal-to-noise ratio decreases, o 2 increases (for 
fixed signal energy), so the choice of model for the prob- 
abilities of various codewords (“source statistics”) becomes 
more important. 


When a stream R is received, we wish to determine which 
was the most likely sent codeword C, or equivalently, which 
bit stream X = (x x ,x 2> * • • ,x k ) was encoded to C, which was 
then transmitted (2k = m in the case of our rate 1/2 convolu- 
tional code). We want to maximize /’(Cli?) over all possible 
codewords C. 

ncm .SEffi& ( a - 2 ) 

so if all codewords are equally likely, we may equivalently 
maximize P(R \ C) over C. This in turn is the same as minimiz- 
ing 

m 

E ( r ,- c i? (A0) 

/=i 

since nothing else depends on C. 


We wish to add as little complexity as possible to the 
Viterbi algorithm, so we would like to assume that the source 
is Markov, meaning the probability distribution of x. given x , 
x 2 , * * • , Xj_ x really only depends on x f _ r , • • • , x |V1 for some 
small r. Unfortunately, since each pixel is represented by one 
8-bit byte, the natural statistics (of one bit to the next) are not 
even stationary, so we are forced to do all computations one 
byte at a time instead of one bit at a time. We have modeled 
the source statistics as byte-by-byte Markov; that is, if bytes 
are labeled X i9 with X i = *8(/-i)+i > * * * » we ^ ave m °deled 

£ 

P(X) = P(x v x 2 , • •• ,x & ) = P(X t ) f[ Pix.w.j 

1=2 

(A-6) 

In addition, we have modeled P(X i \X._ x ) as a function of 
the absolute differences in grey level (pixel value). 


Current decoders use Viterbi’s algorithm, which finds the Each step of our convolutional decoder decodes one byte 

string which minimizes Eq. (3) without searching every possi- or pixel, and the process minimizes 
ble codeword. 


If it is not the case that all codewords are equally likely, 
the analysis above is only valid through Eq. (2). Instead, when 
we maximize / > (C|£), we must maximize 


7^= — FI exp [-(/•.- c.) 2 /2a 2 ] P(C) 


(A-4) 


E 


8 

E ( r 8('-l)+/ 

/=i 


C 8(/-l) + / )2 - 2a2l08 ^ IA .-l )) 


(A-7) 


where we assume P(X t \X i x ) is actually distributed as modeled 
above. 
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Erasure Information for a Reed-Solomon Decoder 

G. H. Pitt, III, and L. Swanson 
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Many Reed-Solomon decoders , including the one decoding the outer code for Voyager 
data from Uranus ; assume that all symbols have the same chance of being correct or 
incorrect. In some cases , like in a burst of incorrect symbols , this is not the case , a 

Reed-Solomon decoder could make use of this. We examine the use of information about 
bit quality sent to the Reed-Solomon from an (inner) Viterbi decoder and information 
about the error status of adjacent symbols in decoding interleaved Reed-Solomon en- 
coded symbols , and discover that , in a region of interest, only about 0.04 dB can be 
gained. 


I. Introduction 

A digital coding system, used on Voyager and as an interna- 
tional coding standard, is shown in Fig. 1. The decoding for 
this system, as implemented in the deep space network and at 
JPL, is shown in Fig. 2. The Reed-Solomon code is able to 
make use of soft-quantized data, however, especially in the 
form of symbol erasures. This article considers the value of 
passing “erasure information” to the Reed-Solomon decoder. 

Our Reed-Solomon code is an 8-bit (255, 223) code. This 
means that each word consists of 255 symbols of 8 bits each. 
Of these symbols, 223 are information and 32 are parity. The 
code allows any 16 symbol errors to be corrected. But the 
code in fact has greater erasure correction capability. If some 
symbols are lost, or if there is reason to believe that some 
symbols are in error, they can be declared “erasures.” The 
code can correct any word in which 2e + E < 32, where e is 
the number of errors in the word and E is the number of 
erasures. 

From time to time, methods have been discussed to make 
use of this erasure correction capacity. One is to develop a 


method of determining quality information for Viterbi de- 
coded bits from the rate of decoder metric renormalization, 
and to erase those symbols which contain bits of bad quality. 
Another is to make use of the interleaving of Reed-Solomon 
words (Fig. 3) to erase symbols which are adjacent to incor- 
rect symbols. (This uses the fact that errors in a Viterbi 
decoded stream fall in “bursts”; Ref. 1.) We have used a 
software Viterbi decoder simulator written by Fabrizio Pollara 
to simulate a number of possible methods for the Viterbi 
decoder to pass quality information bits; these are described 
below, but none of them is satisfactory. We have studied the 
method of using information from interleaved words; this 
gains only about 0.04 dB, but at some signal-to-noise ratios 
this improves the bit error rate by about 50%. (This method 
may be used by the European Space Agency during its Giotto 
mission.) 

II. Erasure Information from the 
Viterbi Decoder 

A problem with determining quality information for 
Viterbi decoded bits from the rate of metric renormalization is 
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that we don’t know how the metric renormalization is imple- 
mented in the Viterbi decoder, but we can simulate it by 
examining the change in the best (smallest) metric over time. 
We assumed that we could find the exact best metric after any 
bit and compare the observed byte errors to the difference in 
the best metric over 8 consecutive bits. This method should 
give us results at least as good as in any kind of renormaliza- 
tion scheme. 

It is unclear whether the highest correlation will occur by 
comparing the difference in metrics from the beginning of a 
byte to the end of it, or from the nt h bit in the byte to the nth 
in the next, or even by comparing one byte’s metrics to 
another byte, so we used programs that would allow the user 
to try all of these schemes (Fig. 4). The difference in best 
metric (BM) was computed from the nth bit in one byte to the 
nth bit in the next and compared to the /nth byte away. Then 
m and n were varied to achieve the highest correlation. 

After shifting bits and metrics to find the highest correla- 
tion on several simulations, we found very little correlation at 
all. We used a program that assumes that all bytes with a cor- 
responding metric above a certain threshold (set by the user) 
will be erased, and calculates the improvement gained in bytes. 
For example, an improvement of 2 bytes means that the Reed- 
Solomon decoder will react (decode or not) as though there 
were 2 fewer byte errors than before. Of course, this number 
means nothing unless compared with the number of bytes 
observed. 

With 896 bytes observed at 0 dB, the best gain found was 
15.5 bytes over the 373 bytes in error using conventional 
means, a gain in byte error rate from 0.364 to 0.349. Reed- 
Solomon frames essentially never decode at either of these 
error rates (less than 0.001% of the time), so there is no gain. 
There can be gain from erasures only if the Reed-Solomon 
word decodes after erasures. 

With 3968 bytes observed at 1.5 dB (an interesting area for 
Reed-Solomon encoded data), the best gain found was 1 byte 
(2 predicted errors and 2 occurrences) over the conventional 
201 bytes in error, a gain in byte error rate from 0.0507 to 
0.0504. Considering the fact that there would almost never be 
more than one erasure in a frame (less than 1% of the time), 
this is no real gain at all. There can be gain from erasures only 
if there are at least two of them. 

III. Erasure Information From Interleaved 
Reed-Solomon Words 

Examining erasure based on interleaving of Reed-Solomon 
codewords proved more profitable. We ran the simulation for a 
long time and made a graph of the symbol error bursts (Fig. 


5). Then, given an undecoded word W., we found the probabil- 
ity that the previous word W {1 decoded and erased all sym- 
bols in W. following those symbols which were corrected in 
W._ 1 . Possibly an even better scheme is erasing only symbols 
in W. surrounded by two detected in error (in and PV. + 1 ), 
which works only if the words on both sides of W. decode. 

Taking into account the fact that not all undecoded words 
have an adjacent decoded word (only 77% do at 1.7 dB), and 
even given that an adjacent word decodes the probability of 
decoding is not 100% (37% will then decode), only 29% of the 
previously undecoded words will decode with this scheme 
(Fig. 6). 

The gain may now be calculated by making a graph of the 
probability of an undecoded word for the regular decoder and 
for the new one (Fig. 7). The calculated estimate of the prob- 
ability of decoding previously undecoded words for 2 dB was 
about the same as for 1.7 dB, so the gain for this one-sided 
scheme is about 0.02 dB. 

At 1.7 dB, the statistics in Fig. 5 show that if the symbol 
before a given symbol is in error but the one after it is not, the 
symbol in between is more likely to be correct than incorrect. 
Therefore, if an undecoded word is surrounded by two de- 
coded ones, erasing all symbols which are adjacent to exactly 
one detected in error loses more than it gains. However, if only 
symbols surrounded on both sides by symbols are erased, 10 
times as many symbols in error as correct ones will be erased. 

We calculated that 61% of the undecoded words are sur- 
rounded by two decoded words. Even those 61% will not de- 
code with probability 1 , but a good guess (derived from the 
assumptions in the appendix) is that about 81% will now 
decode. Therefore, about 50% of the previously undecoded 
words will now decode at 1.7 dB (Fig. 6). 

The gain may be calculated by making a graph of the prob- 
ability of an undecoded word for the regular decoder and for 
the new one (Fig. 7). We assume that the estimated probabil- 
ity of decoding previously undecoded words for 2 dB is about 
the same as for 1 .7 dB, so the curve may be drawn. The gain 
for this two-sided scheme is about 0.03 dB. 

From the above information, we may naively estimate the 
probability of decoding previously undecoded words if we 
try the two-sided scheme when both W i _ 1 and W i+1 decode 
and the one-sided scheme if only one of them decodes. 

The probability that exactly one side decodes is 2 X (77% 
- 61%) = 32% and 29% of those will now decode, so we get 
50% + (32% X 29%) = 59% of the previously undecoded words 
to now decode (Fig. 6). 
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The gain may be calculated by making a graph of the 
probability of an undecoded word for the regular decoder and 
for the new one (Fig. 7). We assume that the estimated prob- 
ability of decoding previously undecoded words for 2 dB is 
about the same as for 1 .7 dB, so the curve may be drawn. The 
gain for this combination of the two schemes is about 0.04 dB. 

Figures 6 and 7 show the probability of not decoding a 
word instead of the probability of not decoding a single 


symbol. To Find that, one must multiply by the fraction of 
symbols in error given that a word doesn’t decode (the mean 
number of symbols in error given that a word doesn’t decode 
divided by 255). These new schemes decode most of the 
undecoded words with a low number of errors, so the fraction 
of errors given that a word doesn’t decode will increase and 
the symbol error rate gain may not be quite as good. (The 
change in mean number of symbols in error given that a word 
doesn’t decode should be about from 20 to 21.) 
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Fig. 1. A digital data coding scheme 


Fig. 3. The 5 interleaved (vertical) Reed-Solomon codewords of 
255 symbols each. Notice the sequence of the symbols. 



Fig. 4. Difference in best metric (BM) vs byte error status (S) 
comparisons. Variable n is the bit in the byte where you want to start 
computing and m is the byte shift. 



LENGTH 

Fig. 5. A graph of the length of bursts for 1, 1.7, and 2 dB as observed in simulation and 
normalized to 1500 errors at each £^/N 0 
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SCHEME 

Fig. 6. A graph comparing undecoded word rates for the old scheme and the three new ones 



Fig. 7. A graph of the probability of an undecoded word for the 
old scheme and the three new ones 
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Appendix 


The above analyses may all be derived from the following 
assumptions (Viterbi decoder errors occur in “bursts”; Ref. 1) 
and observations using the software Viterbi decoder at 1.7 dB. 

Total number of symbols = 38528 
Total number of errors = 1497 
Total number of bursts = 659 

Number of correct symbols with two adjacent incorrect 
symbols = 33 

Total number of triple errors = 430 

If W. = word i and E. = the number of errors in W. then we 
assume: 


P(W. now decodes | W hl decoded and E. = 17) = 100% 

P(W i now decodes | W i _ l , W M decoded and E i = 18) = 90% 

P(W { now decodes | W i _ l , W i+i decoded and E ( = 19) = 55% 

P(W t now decodes I W ( _ v W Hl decoded and E t = 20) =10% 

P(W ( now decodes | , W i+l decoded and E t = 21 to 

255) = 0% 

In the one-sided scheme, we assumed that only symbols 
that were adjacent to a symbol that decoded with the normal 
decoder may now be affected by the new new scheme. This 
makes the estimate a little low since we could decode one 
word with the new scheme and then use that information to 
decode the word next to it, but this would seem to happen so 
infrequently that we didn’t try to estimate its probability. 
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This article describes a VLSI architecture and layout for an 8-bit finite field multi- 
plier . The algorithm used in this design was developed by Massey and Omura (Ref 1). 
A normal basis representation of finite field elements is used to reduce the multiplication 
complexity. It is shown in this article that a drastic improvement has been achieved in 
this design. This multiplier will be used intensively in the implementation of an 8-bit 
Reed-Solomon decoder and in many other related projects. 


I. Introduction 

The era of VLSI digital signal processors has arrived and its 
impact is evident in many areas of research. The trend is to 
put more and more elements on a single silicon chip in order 
to enhance the performance and reliability of the system. 
These techniques are currently being used in the VLSI-based 
Reed-Solomon decoder using a small number of chips. Con- 
ventional decoders use several hundred chips. Our research 
has shown that it is possible to fabricate an entire decoder 
on a single chip. 

Recently, finite field theory has found widespread applica- 
tions. Examples include cryptography, coding theory and 
computer arithmetic. What is more, finite field arithmetic is 
the central part in the implementation of Reed-Solomon 
coders. Because there are quite a few finite field multiplica- 
tions in the Reed-Solomon decoding algorithm, a small finite 
field multiplier is urgently needed for the implementation of 
a single VLSI chip Reed-Solomon decoder. 

The major problem encountered in designing a small 
multiplier with the conventional method is the large quantity 
of hardware required. The conventional methods for imple- 
menting a finite field multiplier use either full parallel or 


table look-up algorithms. These methods lead to architectures 
that are not easily realized in a VLSI circuit. Massey and 
Omura (Ref. 1) recently developed a new multiplication 
algorithm for Galois fields based on a normal basis represen- 
tation of field elements. In this article, a pipeline structure 
based on Massey and Omura’s algorithm, developed in Ref. 2, 
is used to realize an 8-bit finite field multiplier. It is shown in 
this article that the chip area of this 8-bit multiplier is only 
about 1.3 times larger than the 4-bit multiplier designed and 
fabricated previously. 

II. A Functional Description of the 8-Bit 
Multiplication Chip 

The function / as described in Ref. 2 is chosen to be the 
following expression: 

f( a 0> Q l ’ a 2’ a 3’ a 4’ J 5’ a 6’ a 7’ ^0’ ^1 5 ^2 » ^3’ ^4’ ^5* ^6’ ^7^ 

= * 5*0 + °6 b 0 + * 3*1 + a S b l + * 4*2 + 0 5 b 2 + * 6*2 + * 7*2 

+ 0 l b 3 +a 4 b 3 +a 2 b 4 +a 3 b 4 +a 0 b 5 + tf,Z > 5 + a 2 b $ +a & b 5 

+ * 0 * 6 + * 2 * 6 + * 5 * 6 + * 6 * 6 + * 2*7 <0 
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where the generator polynomial of this finite field is 

s(A0 = X s +X S +X* +X+ 1 (2) 

There are a variety of different possible expressions of the 
function /; however, the one above was chosen because it has 
the least number (21) of terms (Ref. 3). Since each term in the 
expression represents a conduction line in the AND-plane of a 
PLA (programmable logic array), then obviously , the fewer the 
terms are, the less area will be spent in implementation. 

An overall block diagram of the chip is shown in Fig. 1 . In 
Fig. 1, Vdd and GND are power pins. The signals PHI-1 and 
PHI-2 are two non-overlapping phases of a system clock. The 
input bits of the multiplicand and multiplier are fed into the 
chip serially through the data input pins, DATA-IN 1 and 
DATA-IN2. Similarly, the product of these two elements is 
transmitted out of the chip sequentially from the data output 
pin, DATA-OUT. The control signal LOAD is high for one bit 
time every 8 bits. The signal N-LOAD is just the logical com- 
plement of signal LOAD. Both the LOAD and N-LOAD signals 
are used for converting input data from serial type to parallel 
type. 

Figure 2 shows the block diagram of an 8-bit finite field 
multiplier using Massey -Omura’s normal basis algorithm. The 
circuit is divided into three units which are discussed in the 
following: 

(1) Serial- to-Parallel Unit. This unit performs the serial to 
parallel conversion of input data sequence. In Fig. 3,^-s and 
2-s, for 1 < i < 2, represent 7-bit and 8-bit shift registers with 
parallel load, respectively. The input bits of the multiplicand 
and multiplier are first stored in the R t registers. These data 
will then be loaded into the Q t registers for every eight clock 
cycles. To reiterate, when signal LOAD is low and N-LOAD is 
high, data come in bit by bit. At the eighth clock cycle, signal 
LOAD is high and signal N-LOAD becomes low. Data in the 
R t registers will then be loaded into Q f registers. The output of 
Q i registers is the input of the AND-generation unit. 

(2) AND-Generation Unit . This unit generates the ANDed 
terms of the input bits of the multiplicand and multiplier. The 
AND functions are configured in a structure of AND-plane of 
PLA because of the regularity and modularity that a PLA 
possesses. The inputs to this unit are the complemented values 
of the input bits of the multiplicand and multiplier. The out- 
put of this unit will be the ANDed terms of the input. These 
ANDed terms will be sent to the exclusive-or unit. 

(3) Exclusive-Or Unit. In finite field arithmetic, if the 
ground field is GF( 2), addition is just the exclusive-or opera- 
tion. Since there are twenty additions in Eq. (1), twenty 
exclusive-or cells are required for the conventional method 


to implement these exclusive-or operations. Because each 
exclusive-or cell needs a substantial amount of chip area, 20 of 
these will consume so much area such that a small multiplier 
will not be possible .Consequently, this will prohibit the imple- 
mentation of a single chip 8-bit Reed-Solomon decoder. In our 
design, an alternate way for implementing the exclusive-or 
operation is used. This new technique was developed and used 
in the fabrication of the Multicode Convolutional Encoder 
chip (Ref. 5). 

Figure 4 shows the block diagram of the conceptual exclu- 
sive-or array. This array comprises twenty-one subcells. Each 
subcell performs a switching operation. As shown in Fig. 5, if 
input A is a “one,” i.e., it is high, then its complement signals 
is low and signals SI and S2 will be switched. On the other 
hand, if signal A is low, then A is high and signals SI and S2 
will not be switched at this moment. 

There are two signal paths through each row of the sub cell. 
At the extreme left of the array, a “one” is connected to one 
of these and a “zero” to the other. Each time this pair of 
signals passes through a subcell, they exchange places if the 
corresponding output of AND-generation unit is “one.” In 
this way, the pair of signals has gone through a number of 
path exchanges equal to the number of ones in the AND- 
generation unit output. If the number of ones of the AND- 
generation unit output is even, then the signals are in the same 
places as they started. If the number of ones is odd, they will 
come out reversed. 

III. The Estimated Performance of the 
8-Bit Multiplier 

The 8-bit multiplier chip was designed using the UNIX- 
based integrated CAD system (Ref. 6). The entire chip was 
simulated on a general purpose computer using ESIM (a logic 
level simulation program; Ref. 7) and SPICE (a transistor level 
simulation program; Ref. 8). The layout of the multiplier was 
accomplished using the program CAESAR (Ref. 9). LYRA 
(Ref. 10) was used to check the resulting layout against a set 
of geometric rules supplied by the fabricator. Timing simula- 
tion was done using CRYSTAL (Ref. 11). The circuit com- 
prises about 2000 transistors. 

The chip described here was sent out for fabrication through 
the MOSIS service (Ref. 12). The technology used was 3 jum 
NMOS. When the completed chips return they will be evaluated 
and tested. The layout of the multiplier is shown in Fig. 6. 
The area of this chip is 1200 X 900 /im 2 while the chip area 
of a 4-bit finite field multiplier designed previously is 1000 X 
800 jum 2 . The 8-bit one is only 1 .3 times larger than the 4-bit. 
The estimated operation speed of this chip is 10 MHz and the 
estimated power consumption at this frequency is 30 mW. 
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This article presents a description of a working single chip implementation of a Reed- 
Solomon encoder. The code used is the CCSDS (Consultative Committee on Space Data 
Systems) standard (255, 223) code . The architecture that leads to this single VLSI chip 
design makes use of a bit-serial finite field multiplication algorithm of E. R. Berlekamp. 


I. Introduction 

A concatenated coding system consisting of a convolutional 
inner code and a Reed-Solomon outer code has been adopted 
as a guideline for downlink telemetry for future space missions 
by CCSDS (Consultative Committe for Space Data Systems) 
(Ref. 1). The participants in this committee include the 
European Space Agency (ESA) and NASA as well as space 
agencies from many other nations. The convolutional inner 
code is the same (7, 1/2) code used by NASA’s Voyager 
project. The outer Reed-Solomon code is a (255, 223) block 
code on 8-bit symbols and it is capable of correcting up to 
16 symbol errors. The performance of such schemes is investi- 
gated in Ref. 2 where it is shown that this concatenated channel 
provides a coding gain of almost 2 dB over the convolutional- 
only channel at a decoded bit error rate of 10 -5 . One of the 
benefits of concatenated coding, and one of the main motiva- 
tions for its acceptance as a standard system, is that it provides 
for a nearly error-free communications link at fairly low signal 
power levels. This means that source data compression tech- 
niques (Ref. 3) can be used to help increase channel through- 
put without a substantial change in overall error rate. An end- 
to-end study of a system using concatenated coding with data 
compression can be found in Ref. 4. 


A Reed-Solomon encoder is basically a circuit which per- 
forms polynomial division in a finite field. Such circuits are 
well known (Ref. 5) and their implementation is straight- 
forward. The major problem in designing a small encoder is 
the large quantity of hardware that is necessary to perform 
the finite field multiplications. Due to the limited weight, 
space and power that can be allotted to a spacecraft instru- 
ment, the equipment used must be as light and as small as 
possible. Therefore, a single chip Reed-Solomon encoder can 
be a significant advantage in deep-space probe missions. This 
encoder represents a considerable space, weight and power 
savings over the smallest existing encoder (about 30 chips). 

A conventional encoder described in Ref. 5 for the (255, 
223) RS code, requires 32 finite field multipliers. These multi- 
pliers are usually implemented as full parallel multipliers or 
table look-up multipliers. The use of either of these multi- 
plication algorithms prohibits the implementation of the 
encoder on a single medium density VLSI chip. 

Fortunately, E. R. Berlekamp (Ref. 6) developed a serial 
algorithm for finite field multiplication. Berlekamp’s algorithm 
requires only shifting and exclusive-or operations. Recently, it 
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was shown (Ref. 7) that this multiplication algorithm has 
enabled the design of a workable VLSI architecture, and that 
this new dual-basis (255, 223) RS encoder can be realized 
readily on a single VLSI chip with NMOS technology. This 
article presents the results of the implementation and testing 
of the RS encoder. 


II. A Single VLSI Chip of a (255, 223) 

RS Encoder 

Berlekamp’s bit-serial multiplication algorithm for a (255, 
223) RS-encoder over GF(2 8 ) is presented in Refs. 6 and 1 } 
A VLSI architecture for implementing this encoder using 
Berlekamp’s multiplication algorithm is presented in Ref. 7. 
The block diagram of the (255, 223) RS encoder is exhibited 
here in Fig. I. 2 In Fig. 1, one observes that the circuit is 
divided into five units: the Product unit, Remainder unit, 
Quotient unit, I/O unit, and Control unit. The use of each unit 
is explained in detail in Ref. 7. An overall block diagram of 
the implemented chip is shown in Fig. 2. In Fig. 2, VDDand 
GND are power pins. The signals and 0 2 are the two phases 
of a system clock. The information symbols are fed into the 
chip serially through the data-in pin, DIN. Similarly, the 
encoded codeword is transmitted out of the chip sequentially 
from the date-out pin, DOUT. The control signal SLis set to 1 
(logic 1) when the information symbols are loaded into the 
chip. After this, SL is set to 0. The control signal “START” 
resets a 3-bit word counter in this chip before the encoding 
process begins. 

The entire chip was simulated on a general purpose com- 
puter using ESIM (a logic-level simulation program; see Ref. 8) 
and SPICE (a transistor level circuit simulation program; see 
Ref. 9). The layout of the encoder was accomplished using the 
program CAESAR (Ref. 10). LYRA (Ref. 11) was used to 
check the resulting layout against a set of geometric rules 
supplied by the fabricator. Timing simulation was done 
using CRYSTAL (Ref. 13). The circuit comprises about 3000 


J See also M, Perlmen and J. J. Lee, “Reed-Solomon Encoders — 
Conventional Versus Berlekamp’s Architecture,” Interoffice Memo 
No. 3610-81-119 ISPM (internal document), Jet Propulsion Labora- 
tory, Pasadena, CA. 

2 Ibid . , Figure 3. 


transistors. It was fabricated using the MOSIS service (Ref. 12) 
and the technology used was 4 /im NMOS. The layout of the 
encoder 3 was modified and the new version is shown in 
Fig. 3(a). A photograph of a fabricated chip is shown in 
Fig. 3(b). 

III. The Procedure for Testing a (255, 223) 
RS Encoder 

The testing of this chip was accomplished at the Jet Propul- 
sion Laboratory (JPL). The JPL testing system consists of a 
custom-built general purpose hardware tester called the Digital 
Microcircuit Functionality Tester (DMFT) (Ref. 14) and a 
VAX 11/750 computer. A program called “Logic” (Ref. 14) 
acts as an interface between these two subsystems. Logic is a 
program which allows a chip designer to create a set of test 
vectors for the functional simulation and testing of a circuit. 
Two types of tests are supported currently. The first is a link 
to the ESIM logic simulator. The second is an interface to the 
DMFT tester. Logic can read and edit files that contain test 
vector and tester configuration information. Once a set of 
test vectors is generated, they may be saved or applied to 
either ESIM or the DMFT tester. The results are displayed on 
the terminal screen in a logic analyzer format. The DMFT, at 
present, is capable of supplying 8 inputs to a chip and moni- 
toring 8 outputs. Each input and output sequence may be as 
many as 4096 bits long. 

Since a codeword for this RS code contains 255 symbols, 
the computation of a complete codeword requires 255 “sym- 
bol cycles.” A symbol cycle is the time interval required for 
executing a complete cycle of Berlekamp’s algorithm. Since a 
symbol consists of 8 bits, a symbol cycle contains 8 “bit 
cycles.” A bit cycle is the time interval for executing one 
step in Berlekamp’s algorithm. 

In this design, a bit cycle corresponds to one period of the 
clock. The total number of clock cycles required to encode 
a single RS codeword is therefore 255 X 2040. 

The chip was successfully tested at up to 3.2 MHz using the 
DMFT. At the maximum clock rate, the chip consumed 
100 mW of power. 


3 Ibid.; see Figure 6 for the original layout of the encoder. 
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Fig. 3. The (255, 223) RS encoder chip: (a) layout, (b) photograph of working chip 
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Carrier Tracking by Smoothing Filter 
Can Improve Symbol SNR 

C. A. Pomalaza-Raez and W. J. Hurd 
Communications Systems Research Section 


The potential benefit of using a smoothing filter to estimate carrier phase over use of 
phase locked loops (PLL) is determined. Numerical results are presented for the per- 
formance of three possible configurations of the DSN Advanced Receiver. These are 
Residual Carrier PLL, Sideband Aided Residual Carrier PLL, and finally Sideband Aiding 
with a Kalman Smoother. The average symbol SNR after losses due to carrier phase 
estimation error is computed for different total power SNRs, symbol rates and symbol 
SNRs. It is found that smoothing is most beneficial for low symbol SNRs and low symbol 
rates. Smoothing gains up to 0.4 dB over a Sideband Aided Residual Carrier PLL, and the 
combined benefit of Smoothing and Sideband Aiding relative to a Residual Carrier Loop 
is often in excess of 1 dB. 


I. Introduction 

Smoothing as a way to improve carrier tracking has been 
proposed and analyzed (Ref. 1). It has been shown that by 
cascading an optimum Kalman smoother with a carrier track- 
ing loop, up to a 6-dB reduction in the phase error variance 
can be obtained with a second order smoother. This work 
presents the potential improvement in the effective data 
signal-to-noise ratio (SNR) by using a smoother in the DSN 
Advanced Receiver. Optimum modulation indexes and side- 
band aiding are used. 

The average symbol SNR, after degradation due to carrier 
phase estimation error (radio loss), is used as a measure of 


performance when comparing the various possible configura- 
tions for the receiver. Also, conditions such as the minimum 
SNR needed to ensure acquisition and lock of the loops are 
satisfied in each case. 

II. Analysis 

The analysis is carried out for three possible configurations 
of the DSN Advanced Receiver. They are: 

(1) Residual Carrier tracking only (RC) 

(2) Residual Carrier plus Sideband Aiding (SA) 

(3) SA plus Smoothing (SM) 
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The received signal for the DSN Advanced Receiver is 
assumed to be of the form (Ref. 2) 

r(t) = \/2P sin (c o.t + A D(t) + © c ) + n(t) (1) 



FT sin 2 A 

N n 


(1 




( 4 ) 


where 

r(t) = received signal (v) 

P = average signal power (v 2 ) 
A = modulation index (rad) 
D(t) = d(t) sgn (sin (co Jc f + © iC )) 


where o^ is the phase error variance. In Eq. (4) it is assumed 
that 0 ^ is small (<3C 1 rad). This is valid for all the cases 
discussed here; thus, for residual carrier tracking only, from 
Ref. 2 


a 


2 

<P 


1 


Vi 

P cos 2 A 


( 5 ) 


d(t) 

Pit) 

0 c 

CO 

sc 
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^ a^pit - £T), a £ = ± 1 with equal probability 

1 for 0 < t < T> 0 elsewhere 
received IF frequency (rad/s) 
carrier phase (rad) 
subcarrier frequency (rad/s) 
subcarrier phase (rad) 


where B h is the single-sided loop bandwidth. 

For residual carrier tracking the modulation index which 
maximizes the average symbol SNR is independent of the 
symbol SNR and satisfies cos 4 A = N Q BjP, under the above 
conditions. This follows from substituting Eq. (5) into Eq. (4) 
and maximizing. 

For sideband aiding, 


VT n c (t) cos (w. f + 0 c ) - V 2 n s (t) sin (co ( . t + © c ) 
is a noise process with n c it) and n s (t) being statisti- 
cally independent, stationary, band-limited white 
Gaussian noise processes with one-sided spectral 
density A^ 0 (v 2 /Hz) and one sided bandwidth W. 

symbol time (s) 


where 


N B 

0 L 


i cos 2 A + _JinlA_ 


i + 


W 


( 6 ) 


The carrier phase estimate is 0 C , and the resulting carrier 
phase error is 0 = © c - @ c . It is assumed that the phase error 
process 0(f) is essentially constant during one symbol time. 
Thus, for example, in the RC case the demodulated waveform 
is 


E s = PT sin 2 A (7) 

Finally, for a smoothing estimator following a loop with 
RC plus SA, the best possible result with a second order 
smoother is (Ref. 1) 


z it) = \fP ~ sin A D{t) cos 0 (f) + n 9 (f) (2) 

where n'(t) is a narrow-band Gaussian process with one-sided 
spectral density N 0 . 

Conditioned on 0(r), the symbol SNR at the output of the 
symbol integration is 

__ PT sin 2 A cos 2 0 ( . 

and the average symbol SNR after losses due to 0, [E 'JN Q ] ave , 
can be approximated by 


■ "V 4 <8) 

The average symbol SNR depends on the modulation index A. 
Therefore, it is necessary to find the best A for each case. This 
best A is that which maximizes [EjN 0 ] ave subject to the 
constraint of sufficient energy in the unsmoothed carrier 
loop to ensure acquisition and lock, without “too many” 
cycle slips. 

One possible way to restrict the modulation index would 
be to assume that there is sufficient carrier power to lock on 
the residual carrier only loop. This restriction leads to an easy 
acquisition procedure, but not to the best effective SNR. We 
therefore use a criterion for RC plus SA locking, which is 
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described as follows. The maximum rms phase error which 
can be tolerated without too many cycle slips is related to the 
average phase detector output versus 0, which is called the 
S-curve. For sideband aiding, the S-curve can be approximated 
(Ref. 2) 


S(<p ) = \J2P [cos A sin 0 + sin 2 0 


(9) 


The value of 0 for which £(0) is maximum can be found to be 


= cos 


cos A +\/l + sin 2 A 
2 sin A 


( 10 ) 


In a conventional PLL, acceptable cycle slipping and acquisi- 
tion is usually achieved with a 2 < 0.2 (loop SNR > 7 dB). 
Since the corresponding S-curve peaks at <P max = tt/ 2, this 
roughly amounts to 


o. < 0.285 0 (11) 

0 r max v 7 

We use as this criterion for sideband aided loops with 0 

r max 

according to Eq. (10). A numerical analysis is then carried out 
to maximize [EJN Q ] ave from Eqs. (4) and (6) subject to the 
constraint of Eq. (11), 


III. Results 

The maximum (over A) average symbol SNR, [E JN ^ ] ave , 
was evaluated for the various tracking methods as a function 
of the ratio of total signal power to noise in the loop band- 
width, P/N q B l , The results are shown in Fig. 1 for EjN Q of 
0 dB, -3 dB, -10 dB, and -20 dB, respectively. Also shown 
on the curves are the modulation indexes which maximize 
the average SNR. Note that, using Eq. (7), the symbol rate 
for any point on the curves can be determined by: 

i p B sin 2 A 

* = 'T = EA Wo ° 2) 


The benefits of sideband aiding relative to residual carrier 
tracking only are shown versus P/N Q B Li in Fig. 2, for the four 
different symbol SNRs. For the higher SNRs, 0 dB to -3 dB, 
the benefit is often greater than 1 dB and sometimes as much 
as 2.5 dB, at low P/N Q B L . The benefit is almost 0.4 dB at the 
highest P/N q B l shown, 500, which corresponds to a symbols 
rate of 500 B L and 1000 B L at symbol SNRs of 0 dB and 
-3 dB, respectively. At a symbol SNR of -10 dB, the maxi- 
mum benefit of sideband aiding is approximately 0.65 dB, and 
occurs approximately at P/N Q B L = 100. At a symbol SNR of 
-20 dB, sideband aiding gains less than 0.1 dB for a\\P/N Q B L 
shown. 

The benefits of smoothing over sideband aiding are shown 
in Fig. 3. At the lowest P/A ^B L shown, 20, the benefits are 
0.38 dB, 0.37 dB, 0.29 dB and 0.25 dB at symbol SNRs of 
-20 dB, -10 dB, -3 dB and 0 dB, respectively. The correspond- 
ing symbol rates are 1100 B L , 124 B L , 33 B L and 18 B L . 
Looking at the results from another viewpoint, smoothing 
gains at least 0.25 dB over sideband aiding at all symbol SNRs, 
provided that the symbol rate is low enough, i.e., less than 
18 B l , 52 B J , 920 B f and 1400 B L for symbol SNRs of 0 dB, 
-3 dB, -10 dB and -20 dB. 


IV. Discussion of Other Conditions 

Results have been presented only for cases in which the 
modulation index is optimized, subject to a lock constraint, 
and in which sideband aiding is used. For any conditions, 
smoothing can reduce the carrier phase error variance, and 
hence the radio loss, by a factor of four. Thus, smoothing is 
a valuable tool whenever the radio loss is large. For example, 
suppose that sideband aiding is not used and the modulation 
index and loop bandwidth are such that the carrier loop SNR 
is 7 dB. Then the radio loss is approximately 0.97 dB without 
smoothing, and 0.22 dB with smoothing, a gain of 0.75 dB. 
On the other hand, if the modulation index for a spacecraft 
is always low enough so that the residual carrier loop SNR 
is high and the radio loss is low, then there is minimal poten- 
tial benefit to either sideband aiding or smoothing. 


Thus, symbol rate, R , is almost proportional to the abscissa 
value in Fig. 1 . 

For the higher symbol SNRs, Figs. 1(a) and 1(b), the use of 
sideband aiding with optimized modulation index results in 
almost 100 percent efficient utilization of received power, 
except at very low symbol rates. There is little to gain by use 
of smoothing, except at low symbol rates. At E JN Q = -20 dB, 
Fig. 1(d), sideband aiding does not improve performance 
very much, but smoothing helps significantly. Both SA and SM 
are significant at -10 dB, Fig. 1(c). 


Smoothing is also beneficial in reducing the effects of 
oscillator noise and spacecraft dynamics, as shown in Ref. 1. 
This might lead to reduction in the loop bandwidth, and thus 
further reduction in radio loss. The impacts on symbol SNR 
have not yet been evaluated. 

V. Implementation, Cost and 
Remaining Problem 

A block diagram for carrier smoothing is given in Ref. 1. 
It is estimated that this can be implemented with one special 
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purpose digital board, plus one single board computer, added 
to the Advanced Receiver. The cost is estimated at S5K to 
$10K per receiver. 

The main problem remaining is the possible effect of non- 
linearities in the phase detectors on the smoothing filter phase 
solution. This needs to be evaluated by simulation before a 
breadboard is developed. 


VI. Conclusions 

Smoothing is a useful tool for carrier tracking at low sym- 
bol SNRs and low data rates. For optimum modulation 
indexes and using sideband aiding, smoothing virtually eli- 
minates radio loss and gains up to 0.4 dB in average effective 
symbol SNR. Larger gains in SNR are possible in cases in 
which sideband aiding is not used, or in which the modula- 
tion index is not optimized. 
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FACTOR = [E s /N 0 l ave /PT/N 



Fig. 1. Comparison of carrier phase tracking loss factor vs total power SNR in loop bandwidth. The symbol SNR is 

(a) 0 dB, (b) -3 dB, (c) -10 dB, and (d) -20 dB. 





SMOOTHING GAIN, dB 



Fig. 2. The gain of sideband aiding over residual carrier tracking 
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A Class of Optimum Digital Phase Locked Loops 
for the DSN Advanced Receiver 

R. Kumar 1 and W. J. Hurd 
Communication Systems Research Section 


This article presents a class of optimum digital filters for digital phase locked loops of 
the DSN Advanced Receiver. The filter minimizes a weighted combination of the variance 
of the random component of the phase error and the sum square of the deterministic 
dynamic component of phase error at the output of the numerically controlled oscillator 
(NCO). By varying the weighting coefficient over a suitable range of values , a wide set of 
filters are obtained such that , for any specified value of the equivalent loop-noise band- 
width, there corresponds a unique filter in this class. This filter thus has the property of 
having the best transient response over all possible filters of the same bandwidth and 
type. The optimum filters are also evaluated in terms of their gain margin for stability and 
their steady-state error performance. 


I. Introduction 

There has been an increasing interest (Refs. 1-4) in the 
study of digital phase locked loops. Such an interest emerges 
in part from the capability of digital technology which makes 
it possible to control the loop parameters accurately and even 
make these programmable and/or adaptive. 

This article derives optimum filters for the digital phase 
locked loops for carrier, subcarrier and symbol timing recovery 
in the DSN Advanced Receiver. The loop is analyzed in the 
z-transform domain so as to arrive at a set of optimum digital 
filters for various input dynamics. 

^Iso with the faculty of Electrical Engineering Department at Cali- 
fornia State University, Long Beach 


The filter minimizes a weighted sum of the variance of the 
random component of the phase error and the sum square of 
the deterministic dynamic component of the phase error at the 
output of the numerically controlled oscillator (NCO). By 
varying the weighting coefficient over a suitable range of 
values, a wide set of filters is obtained such that, for any 
specified value of the equivalent loop noise bandwidth, there 
corresponds a unique filter in this class. This filter thus has the 
property of having the best transient response over all possible 
filters of the same bandwidth and type. 

Three specific filter sets optimum for a phase step, phase 
ramp and the phase acceleration inputs are considered in some 
detail. The corresponding optimum filters are type I, II, and 
III, respectively. Due to the specific optimization index under 
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consideration, the filter design also ensures that the determin- 
istic dynamic component of the steady-state phase error is 
zero for all input phase dynamics with the order of the highest 
order nonzero derivative term smaller than the filter type. 

The open loop transfer function (the product of the transfer 
functions of the filter and the NCO) possesses a multiple pole 
at z = 1 , with its multiplicity equal to the order of the nonzero 
phase derivative plus one. The type of the filter is the multi- 
plicity of the pole at z = 1 . 


II. Optimum Filter 

Figure 1 depicts the block diagram of the basic digital 
phase locked loop (DPLL) and the z domain model of its 
linearized version. In the figure, F(z ) represents the transfer 
function of the digital filter and N(z) is the transfer function 
of the NCO and the transport lag in the loop, due to the 
specific implementation. We use the N(z) appropriate for the 
DSN Advanced Receiver (Ref. 2), 


2z 2 (z - 1) 


(1) 


where K is some constant and T is the sampling period. Such 
an NCO transfer function results because of the limited loop 
update rate l/T. Similar results are possible for other N(z). 


The input noise £(f) is assumed to be a zero mean white 
Gaussian noise with two-sided spectral density NJ2. The noise 
n.(t ) is the real part of the complex envelope of £(r) and is also 
white Gaussian with spectral density N . 

In Fig. 1(b) is given a linearized and discrete-time version of 
the DPLL wherein {«.(£)} represents a zero mean white 
Gaussian sequence with variance (NJA 2 T). In this model 0 
may be decomposed into a sum of \p(k) and n Q (k) where 
\l>(k) represents the deterministic part of © while n 0 (k) is the 
stochastic component. The optimum filter is derived by 
minimization of the following index (Refs. 4, 5, 6): 


2 = £[«J(t)]nJ]e 2 W (2) 

k 

with e(fc) = ©(/:)- i//(/r) denoting the deterministic compo- 
nent of the phase error. The parameter X is selected from the 
consideration of the loop noise bandwidth and the transient 
performance of the loop, which are functions of X for the 
optimum solution. In the sequel, the parameter X is expressed 
in terms of N Qt T and an appropriate normalized parameter. 
Thus, for example, when the input phase is a step function of 


time, X = N Q Tq where q is the normalized parameter. The first 
term in the index Q can be expressed in terms of the loop 
filter F(z) as 





(3) 


with <h„ o „ o (z) denoting the noise spectral density of n 0 (k). 
Now 


<*Vo (z) = H ( z )H{z- x )* npi (zy, 


H(z) = 


1 + F(z) N(z) 


<l> 


n Pi ( z ) 



N Q = NJA 2 


Similarly, the second term in Eq. (2) can be evaluated in 
terms of the following contour integral (T denotes the unit 
circle), 


5^e 2 (*) = 2 nf f E( A)E{z *)y7 £'(z) = Z[e(/r)] 

k Jr 

where Z denotes z -transform. As£(z) = (1 -//(z))0(z) (where 
0(z) denotes z-transform of 6(k )), an equivalent expression 
for the sum of squared errors is 


^ e2(fc) = h [ (i-^))(i-^-'))4» s9 ( z )f; 

k y J r 

<D e0 (z) = 0(z)0(z->) (4) 

From Eqs. (3) and (4), the optimization index Q may be 
rewritten as, 

Q = 2^7 f P& g g(?) +p ( z )W(. z ) w (z _I ) 

J r 

- \W(z)N(z)$ g Jz) - XW'(z~ 1 )AKz _1 )$ ( , ( ,(z)] * ; 

H(z) = W(z)N(z)-, P(z) = [NJ + X$ ee (z)] N{z)N{z~ l ) 

(5) 
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The optimum solution for W(z) and thus H(z) can then be 
obtained from the spectral factorization (Refs. 4,5,6) as 


w 0& = 


z 

\N(z l )$ eg (zj 

+ 

_ zP~ ( z ) . 

P\z) 


P(z) = P + (z)P-(z) 

(6a) 


H{z) = 


V n + V n - 1 + -" + &„ 

v" + «i 2 "' 1 + --- +fl n ’ 


a o^° 


where the coefficients a r , 0 < r < n and b r> 0 < r < n are not 
necessarily nonzero. Then 

12 v = u (8) 


In the above P + (z) denotes that factor of P(z) which has all 
its poles and zeros inside the unit circle, and [C(z)] + , for any 
rational function C(z), represents that part of the partial 
fraction expansion of C(z) whose poles are inside the unit 
circle. 

The optimum loop filter F(z) can then be obtained from 
W Q (z) as 

w o OO 

f 1 « ’ (»> 


where 12 is an n X n matrix and v and u are ^-dimensional 
vectors with the elements of 12 and u being functions of the 
coefficients a’s and b y s. Moreover, the first element of v 
equals a Q B ; thus, B can be computed by solving the set of 
n linear equations (8). In this regards, it is of interest to note 
that the matrix 12 can be decomposed as, 

12 = Sl UT + 12 UH - 12 

where 12^ r and 12^ are upper triangular Toeplitz and 
“upper triangular” Hankel matrices respectively, i.e., 


III. Performance Considerations of 
Optimum Filters 

The optimum filters of the previous section are evaluated 
in terms of various parameters of interest. The most signifi- 
cant parameters are the loop noise bandwidth, transient error 
performance, stability analysis and gain margin, and the 
steady state phase error for an input having a nonzero deriva- 
tive of order equal to the filter type. 

A. Loop Noise Bandwidth 

In terms of the filter performance, it is of interest to 
evaluate the phase noise variance E[n^(k)] as the weighting 
parameter A or its normalized version is varied. This variance 
is given by Eq. (3) and is usually expressed in terms of a 
normalized parameter B given by 


a 0 a i a 2 a 3 
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12 


UT 


0 0 % fl i 


n-2 


0 0 0 0 


*0 a i a 2 a 3 


( 9 ) 


12 


UH 


a a a a 

1 2 3 4 


a a a a 
2 3 4 5 


0 

0 




d n 0 0 0 • • ■ 0 


The parameter B is termed normalized loop noise bandwidth 
and in terms of B , the oscillator phase noise variance is given 
by (N q B/T). In the PLL literature, a loop noise bandwidth 
B l is also defined and equals {B/T) Hz. 


and 12 has its first row equal to [a Q a { a 2 • • • a n \ with the 
remaining rows identically equal to zero. The elements of the 
vector u are expressed in terms of the autocorrelation function 
of the sequence i.e., 


B. Computation of B 

From Ref. 7, the integral for B can be expressed in terms u T = [^,(0) 2/^(1) • • * 2R^(fl)] ; R bb (k) ^ VW 
of the coefficients of H(z). Let /=o 
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With a slight modification, the solution for B can be ex- 
pressed in the following form (possessing a rich structure for 
computational purposes), 

B - — X first element of {(£2^ + £2^)"* u } 
a o 

( 10 ) 

« = [R bb (W bb (»---R bb (»)] T 

The specific structure of the matrix in Eq. (10) can be 
exploited in the fast computation of the bandwidth. Thus, 
when the dimension of the matrix (£l UT + Sl UH ) is high, 
sophisticated algorithms requiring order n log 2 n log 2 n opera- 
tions can be used for solving Eq. (10). 

C. Transient Performance 

The transient performance of the filter is evaluated in 
terms of the index 


2> 2 w 

k 

where e(A;) is the deterministic component of the phase 
error. A smaller value of this index also implies a faster settling 
of the dynamic component of the phase error to zero. In 
principle, the value of this index can be reduced to an arbi- 
trarily small value by choosing the value of the parameter 
X sufficiently high. However, this would have the adverse 
effect of increasing the loop noise bandwidth and degrading 
the noise performance of the loop. The objective is thus to 
arrive at a compromise solution, as in the following section. 

D. Stability Analysis and Gain Margin 

In the preceding derivation of the optimum filter, it is 
assumed that the input signal amplitude A is constant (implic- 
itly assumed to be 1). If the gain A is known then it can be 
taken into account by dividing the constant of F(z) by A. 
However, in actual practice, there may be some uncertainty 
associated with A or A may be a slowly varying function of 
time. In such situations it is essential that the loop remain 
stable for a sufficiently large range of A. 

In the subsequent section, using Jury’s criterion, the 
upper and lower gain margins are evaluated for the closed loop 
stability of the loop. Such an evaluation is particularly impor- 
tant, since the filter derivation does not explicitly take into 
account such an index. 

E. Steady State Error Due to Higher Order Dynamics 

In practice, the signal may possess a component with the 
order of its highest nonzero derivative equal to or greater than 


the type of the filter. For example, the phase locked loop with 

a type III filter may have a nonzero phase jerk at its input. 

In this case, the deterministic component of the steady state 

phase error is nonzero and it may be of interest to evaluate 

the derived filter in terms of such steady state phase error 

0 . 

r SS 


For analog phase locked loops (Refs. 5, 6) (p ss is inversely 
proportional to B ' L , where i denotes the filter type and B L is 
the actual loop noise bandwidth in Hz. As B L = B/T , a suitably 
normalized parameter C^ { is given by C 0 . = (0^)^ B/T, where 
the order of the highest nonzero derivative of the input signal 
is assumed to be equal to /. The variation of C 0 . is studied in a 
subsequent section, as the normalized loop noise bandwidth B 
varies over the range of interest. 


IV. Performance Evaluation of the 
Specific Filter Classes 

In the following, we evaluate the parameters of the opti- 
mum filter W (z) and the loop filter F(z ) as the parameter 
X is varied for the NCO transfer function given by Eq. (1). 
The design of three specific classes of filters is considered to 
correspond to a phase step, frequency step and a frequency 
ramp input to the PLL. These filters are type I, II and III, 
respectively. For each class of filters, various design curves 
are obtained for the parameters and performance including 
the normalized design parameter, the optimum loop gain, 
the pole and zero locations of F(z), the upper and lower 
gain margin for stability, and the steady state error constant 
C^., as functions of the normalized loop noise bandwidth, B. 

A. Optimum Filter for Phase Step (Type I) 

In this case, the input phase function 6(t) = u(t ), the 
unit step function, and thus @(z) = (1 - z" 1 ) -1 . As shown 
in the appendix, the optimum filter ^(z) in this case is 
given by 


= a - ± YT- 


(z ~ 1)Z 
(az 1 + bz + c) 


where a, b and c must satisfy the set of following equations 
ac = -1 


ab + be - q ; q = X/N Q T 
a 2 + b 2 + c 2 = 2 (1 + q) 


( 11 ) 


The optimum loop filter F(z ) can then be obtained from 
PV^z) in a straightforward manner and after a few manipula- 
tions can be written as 
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_ a + + c 
~ 2 (a-c) 


(15) 


F(z) 


2 (a + b + c) 
KT 


xj j 02) 

( 2 az 2 + 2 (& + d)z + (a + b + c) } 

From the computations of the pole-zero locations of F(z), 
it turns out that the filter F(z ) possesses a pole at z = -1 , i.e., 

az 2 + bz + c = {az + Z>) (z + 1 ) (13a) 

where a, b satisfy the following 


1. Filter parameters. In the practice of phase locked 
receiver design, it is customary to treat the normalized loop 
noise bandwidth B as an independent parameter and then 
express various other loop parameters and the performance 
indices as functions of B. In the case of digital PLL, closed 
form expressions of this form cannot possibly be derived/Thus 
to obtain such relationships numerically, we evaluate a , b first 
as a function of q from the modified version of Eq. (13b). 
(Actually for the case of computations, b and q are calculated 
as a function of F which can have values strictly greater than 
1.) In this case, from the modified version of Eq. (13a), we 
also note that a = a, b = b + 0 .9a, c ~ 0.9 b. 


ab = -1 

(13b) 

a 2 + b 2 = 2 + q 

Even though the pole at -1 is optimal, it is desirable to avoid a 
pole-zero cancellation at z = -1 so as to avoid the practical 
problem of imperfect pole cancellation and hence instability. 
Therefore, the filter coefficients are modified so as to shift the 
pole at the unit circle to z = -0.9 (say). Thus the factor (z + 1) 
in Eq. (13a) is replaced by (z + 0.9) with corresponding 
changes in Eq. (13b). 


From Eqs. (1) and (12), the open loop transfer function for 
the type I PLL is given by, 


F(z)N(z) = K opt 


(z- 1) 


(z+1) 


( 2 A tb+a\ A 

(a + b + c\\ 

r + \~) z+ 

V 2a Jj 


In Fig. 2 is plotted the value of the parameter q which is 
required to obtain the normalized bandwidth B for the type I 
PLL. As is apparent from the figure, corresponding to the 
range of B between 0.001 and 0.95, the parameter q varies 
over approximately 7 orders of magnitudes (1CT 5 to 10 2 ). 
To design an optimum type I filter of bandwidth B, one can 
determine the loop gain from Fig. 3 and the pole locations 
from Fig. 4. 


2. Stability. From stability theory, the closed loop system 
corresponding to the open loop transfer function of_Eq._[14) 
remains stable if K opt is replaced by any positive K < K opt . 
However, if K is greater than K opV then the closedjoop system 
may become unstable. The maximum value of K for closed 
loop stability, denoted K max is expressed in terms of the 
upper gain margin G u = 20 log (K max \ K opt ) (dB) and is plotted 
versus B in Fig. 5. As may be inferred from the figure, for a 
normalized loop noise bandwidth B less than or equal to 0.1, 
the optimum filter yields an upper gain margin of 16 dB or 
higher. 


■ 055 (nr) < 14 > 

Moreover, the corresponding closed loop transfer function of 
the PLL is given by 


In Fig. 6(a) is plotted the root locus diagram for a typical 
filter of typel, corresponding to a nominal bandwidth of 
0.0965. As the loop gain is varied around the optimum gain 
K opt , the normalized bandwidth B also varies around its 
nominal value as depicted in Fig. 6(b). 


rr/ ^_a + Z? + c z+1 

H(z) = -x 

1 z(az 2 +bz + c) 

In this case, the normalized loop noise bandwidth B as evalu- 
ated from Eq. (7) has the following closed-form expression. 


3. Transient error performance. Figure 7 plots the integral 
square error, given by Eq. (4) as a function of normalized 
bandwidth. Over the bandwidth range of interest, the error 
varies approximately by two orders of magnitude. Note that 
some suboptimality is introduced due to modification of the 
pole at z = -1 . 
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4. Steady state error due to phase ramp. The steady state 
phase error is given by 


0 = lim (— — -) . 0(^) 

z ^ x \ z I 1 + F(z) N(z) 


0(z) 


T 


(?- l ) 2 


or, 


lim 
z-* 1 


T 

(z-\)F(z)N(z) 


For the optimum Filter (Eq. [14] ) 0^ is given by 


and the parameters a , c, d are the solutions of the following 

set of nonlinear equations. 



ad 

= 1 

ac + bd 

= -2 

be + cd 

= r- 1 

c 2 +d 2 

= 2r + 4 


XT 

Y 

“^0 


Using the identity that (a + b + c + d) 2 = 4 r, and after a 
few algebraic manipulations, the corresponding loop filter is 
given by 


_ rp 5a + 3b + c = r jR 
~ 1 2 (a + b + c) Si 


F(z) 


2 

at 


Figure 8 plots the normalized value of 0^ i.e., C 01 as a func- 
tion of B. The radian phase error for radian center frequency 
co 0 and the spacecraft velocity v is (c o 0 v/c) (C^jB L ) where c 
is the speed of light. 

In Fig. 9 is plotted the location of the closed loop pole as 
a function of B. As can be inferred from the figure, increasing 
the value of B results in the movement of the pole towards 
the origin, thus resulting in faster transient response. 

5. Type I summary. Table 1 lists some of the parameters 
of six typical Filter corresponding to different values of q for 
quick reference. 

B. Optimum Filter for Frequency Step (Type II) 

In this case, the input phase function 6(t) = t u(t) and thus 


0(z) 


Tz 

(z - l) 2 


The optimum Filter W Q (z) is derived in the appendix and is 
given by 



(h 0 z-h x )(z- 1 )z 
4 ( az 3 + bz 2 + cz + d) 


where 

h Q = (7tf + 5Z? + 3c+d) 
h l = (5a + 3b + c - d) 


(hz-h)z 2 

X 

{4az 2 + (8a + 4Z?)z + (5a + 3b + c - d)} (z - 1) 

(17) 

As in the case of phase-step, there is a pole-zero cancellation 
at z = -1 in the filter F(z), i.e., the coefFicients a , b, c, d 
satisfy the following identity 

az 3 + bz 2 + cz + d = (z+1) (az 2 +bz + c) 
where a, b , and ~c satisfy the following set of equations 

ac = 1 
ab + be = - 4 
H 2 + b 2 + c 2 = 6 + r 

The modified coefficients a , b, c, d are then obtained 
according to the following relation 

(az 3 + bz 2 + cz + d) = (z + 0.9) (az 2 + bz + c) 

1. Filter parameters. Figure 10 plots the normalized band- 
width B versus the optimizations parameter r. Figures 11, 12, 
and 13 plot the loop gain and those zeros and poles of the 
optimum filter whose locations depend upon B . A compari- 
son of these plots with the corresponding plots of type I 
Filter indicates that for low values of B , the pole locations are 
nearly the same for both types. Similar remarks apply with 
respect to loop gain. 
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2. Stability. The upper and lower gain margins are plotted 
versus B in Fig. 14. An upper gain margin of 10 dB or higher 
is obtained for all B less than 0.5, and the lower gain margin 
is very large for all B less than 1 . 


The coefficients a , b t c, d and e are obtained by equating the 
coefficients of various powers of z on both sides of 

az 4 + bz 3 + cz 2 + dz + e = (z + 0.9)(oz 3 + bz 2 +cz + d ) 


3. Transient response. The transient response is given in 
Fig. 15. Compared to the type I filter, the transient error 
varies over a much higher range — approximately six orders of 
magnitude. 

4. Steady state error to frequency ramp. In Fig. 16 is 
plotted the normalized steady state phase error constant 
C(p 2 = (0^ 2 f° r a un h frequency ramp input to the PLL. 
A limiting value of just over 1 is approached for B less than 
0.1. The radian phase error for radian center frequency cu Q 
is (co Q a/c ) (C^ 2 /B l ) 2 where a is acceleration (in m/s 2 for 
c in m/s). 

C. Optimum Filter for Frequency Ramp (Type III) 

In this case 


0(z) 


T 2 z(z + 1) 

(z-l ) 3 


and the optimum filter B ; Q (z) is given by (the details similar 
to the first two cases and omitted): 



{Cz 2 +(B-2C)z + (A+C-B)}z(z- 1) 
1 6(az 4 + bz 3 + cz 2 +dz + e) 


(19) 


and the loop filter transfer function F(z ) is given by 


F(z) 


2 

KT 


(21) 

and a, b, c , d are obtained as a solution of the 

ad = -1 \ 

ac + bd = 6 f 

> ( 22 ) 

ab +bc + cd = -(15 - 5 ) ( 

a 2 +~b 2 + c 2 + tf 2 =20 + 2 s; s = -jf— ) 

^0 / 

1. Parameters of type III filter. The parameters of the 
optimum filter, i.e., the loop gain, location of zeros and poles 
(those depending upon B) are quite close to those for type I 
and II filters for B < 0.5. For B > 0.5 however, there is sig- 
nificant difference in the location of poles. For space limita- 
tions the plots of these parameters versus B are omitted. 

2. Performance. The performance indices of the filters 

are plotted in Figs. 17 through 19. As may be inferred from 
Fig. 17, both upper and lower gain margins of 10 dB or 
higher are achieved for normal regions of operation. The 
dynamic error (Fig. 18) has an extremely large range (about 
12 orders of magnitude) for the range of B of interest. This 
suggests a programmable implementation of the PLL for fast 
acquisition as is discussed below. In Fig. 19 is plotted the 
normalized steady state phase error constant C^ 3 = B/T. 
For low values of B , this has a value of approximately 1.5. 
Radian phase error is (co j / c)(C.JB t ) 3 where / is jerk 
(m/s 3 ). o 0 


{Cz 2 +(B- 2 C)z + (-4 + C - B)}z 2 

(z - l) 2 {16az 2 + 16(3 a + b)z + [16(6a + 3b + c) - C] } 

where 


V. Programmable and Adaptive 
Implementations 

From the performance analysis of the optimum filters 
the following adaptive implementations are suggested. 


A = 807 + Z>+c + tf + e) 

B = 4(9 a + lb + 5c + 3c? + e) 


C = 


2 



2Q 1 (b + 2c + 3d + 4e) 
(a + b + c + d + e) 


Q 1 = (9a + lb + 5c + 3d + e) 

Q 2 = (33a + 33Z> + 29c+21d + 9e) 


The phase noise variance at the output of the NCO is given 
by ( N q B/A 2 T ). Thus in those situations where (A 2 /N Q ) (the 
input signal power to noise spectral density) is slowly varying 
with time, in order to maintain the phase noise variance within 
specified limit, say V , a value is obtained from B = V 
T(A /N q ). Then from the plots of the filter parameters 
(stored in the memory in the form of tables versus B) an 
optimum filter corresponding to B is obtained. This filter 
then also has the best transient response consistent with the 
desired phase variance. 
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Because the transient error varies over an extremely large 
range (about 12 orders of magnitude for type III filter), a 
rapid acquisition can be attained in the following manner. 
Starting with a sufficiently high value of B (thus very rapid 
settling of the loop), the loop parameters are adjusted, at an 
interval of several times the dominant time constant of the 
filter, to the values corresponding to successive lower values of 
B until the desired value of B is achieved. 

As the filter poles location are not sensitive to the input 
dynamics, a serial implementation of the filter is suggested. 
Acquisition can be accomplished with a type II loop, which 
has a good transient response, and then the type can be 
increased by type III by adding a pole at z = 1. The feasibil- 
ity of acquisition with the type II loop depends upon an esti- 
mate (upper bound) of the magnitude of the acceleration. 

VI. Conclusions 

The performance of a class of optimum filters for three 
different input phase dynamics has been evaluated. The filters 
achieve minimum transient error for any loop bandwidth. 
The optimum filter is such that the open loop transfer func- 


tion has multiple poles at z = 1 with the multiplicity m equal 
to one plus the number of nonzero derivatives (/ > 0) terms 
of the input. In addition the filter has an optimum compen- 
sator with its denominator polynomial of degree 2 and the 
degree of numerator polynomial equal to m . 

The parameters of the optimum compensator have been 
obtained as a function of an optimizing parameter q . Increas- 
ing the value of q has the effect of weighing more heavily the 
deterministic component of the phase error. This has the 
effect of achieving smaller transient error by increasing the 
loop gain, placing the open-loop poles closer to the unit circle 
and the filter zeros close to the origin. Alternatively, higher 
values of q bring the poles of the closed-loop system closer to 
the origin. Such a behavior of the system may be very desir- 
able during the acquisition phase of the loop. Thus, in an 
adaptive implementation, a loop filter corresponding to high 
values of q may be used during the acquisition phase. During 
the tracking phase then a filter corresponding to a lower 
value of q may be switched in. 

The filters designed on this basis also have good margin 
against possible variations in the received signal power level. 
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Table 1. Performance of optimum filters (type I) corresponding to different values of the parameter q 


Q 

Optimum 
Loop Gain 
K Optimum 

Optimum 
Loop 
Noise BW 

Loop Transfer Function 

Range of 
AT for 
Stability 

Gain 
Margin 
in dB 

Bandwidth Over 
±12 dB Gain 
Variation 

0.0364 

0.1649 

0.0965 

z + 1 

0.002-1.091 

-38,16.4 

0.018-0.945 

(z-l)(z 2 + 1.07362 + 0.1649) 

0.1344 

0.2903 

0.1786 

Z+1 

0.002-1.204 

-43, 12.35 

0.034 - 1.2 

(r -1 )(z 2 + 1.2056z + 0.2903) 

0.4702 

0.4653 

0.3189 

z + 1 

0.002 - 1.380 

-47, 9.66 

0.11-1.35* 

(z - 1) (z 2 + 1 ,390z + 0.4653) 

1.548 

0.6568 

0.5140 

z + 1 

0.002 - 1.60 

-50,7.73 

0.17-3.8* 

(z - 1) (z 2 + 1.5914z + 0.6568) 

i n 77 


0.8127 

z + 1 

n nn 7 i sn<; 

-52.8, 6.31 

n oc i o * 

IU.jj 

u.o /zh 

(z - 1) (z 2 + 1.8184z + 0.8724) 

U.UUZ — 1 ,oUj 

U.Zj — 10 . 

180.2 

0.9448 

0.9401 

Z+1 

(z - 1) (z 2 + 1.8945z + 0.9448) 

0.002 - 1.88 

-53.5,6.0 

0.30 -38.* 


^Entries correspond to ±6 dB gain variation. 
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OPTIMUM PARAMETER 



Fig. 1. Digital phase locked loop: (a) basic phase locked loop, 
(b) linearized model 




Fig. 3. Optimum loop gain vs normalized bandwidth 
for type I filter 



Fig. 4. Pole locations of the optimum loop filter of type I 


Fig. 2. Optimum parameter g for loop filter of type I 











Fig. 5. Upper gain margin vs normalized bandwidth 



LOOP GAIN, K 

Fig. 6. Performance of type I filter vs loop gain: (a) root locus 
diagram for type I PLL, (b) loop noise bandwidth vs loop gain K for 
type I filter (nominal BW = 0.0965) 
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OPTIMUM LOOP GAIN 



Fig. 11. Optimum loop gain vs normalized bandwidth 
for type II filter 



Fig. 12. Zero location of the optimum loop filter of type II 



Fig. 13. Pole locations of the optimum loop filter of type II 
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INTEGRAL SQUARE ERROR DUE TO 

UNIT FREQUENCY RAMP •* GAIN MARGIN, dB 




o 

z 


NORMALIZED BANDWIDTH, B 

Fig. 16. Steady state error performance of type II filter 


Fig. 15. Transient error performance of type 11 filter 





INTEGRAL SQUARE ERROR DUE TO 

UNIT FREQUENCY RAMP T| GAIN MARGIN, dB 



g. 17. Gain margin vs normalized bandwidth for type HI filter 



LU 



NORMALIZED BANDWIDTH, B 

Fig. 19. Steady state error performance of type III filter 


Fig. 18. Transient error performance of type III filter 





Appendix 


In the following, we derive the transfer functions of the 
optimum filters for various phase dynamics considered in the 
article. 

I. Case 1: Phase Step 

In this case 0(z) = (1 -z -1 ) -1 , and the expression for P{z) 
can be easily evaluated as, 


This is in view of definition of [ ] + and the fact that the roots 
of a + bz + cz 2 = 0 are outside the unit circle. Substitution of 
Eq. (A-3) and the expression for P~(z) from Eq. (A-2) into 
Eq. (6) yields the following expression for ^(z), 

w ( Z ) J_ . *( z . - p._ 

° U (“ + b+c)KT (az 2 + b2 + c) 


K 2 N q ^ (^l ) 2 ( _ q _z 
4 (z-1) 2 ( (z-1) 2 


From Eq. (7) and the expansion for (a + b + c) 2 , it follows 
that (a + b + c) 2 = 4 q, and the expression for W 0 (z) can be 
simplified to the one given in Section IV. 


I^NqT 3 z 4 - qz 3 - 2(1 + q)z - qz + 1 


(z-1) 4 


(A-l) 


Factorization of P(z) yields. 


d/ \ \ F N o T ( az 2 +hz + c)\ v {az 2 + bz' 1 +( 

f<2) \— 


(A-2) 


Straightforward substitution yields that, 

1 - W 0 (z) N(z) 

__ 2 az 3 + 2 bz 2 + (c - a - b) z - (a + b + c) 
2z(az 2 +bz +c) 

and the optimum loop filter is given by 
F(Z) = 1 - W q (z)N ( z ) 


where the two bracketed terms in the above represent P + (z ) 
and P~(z ) respectively. Comparing the coefficients of equal 
powers of z in the equivalent expressions (A-l) and (A-2), 
the following set of equations (referred to above as Eq. [11]) 
are obtained. 

ac = -1 
ab + be = q 
a 2 + b 2 + c 2 = 2(1 +q) 

The above set of equations can then be solved for unknown 
a, b, c. 


= 2(a + b+ c) x z 2 (z - 1) 

2 az 3 + 2 bz 2 + {c-a- b)z - (a + b + c) 

Cancellation of the factor (z-1) common to both the numer- 
ator and denominator yields Eq. (12). 


II. Case 2. Frequency Step 

In this case 0(z) = Tz/(z - l) 2 , and the P(z) is given by 


Now, 

AV(z~ 1 )4> e0 (z) = (z + l)z 2 

zP~(z) 2 (z - 1)(a + bz + cz 2 ) 

Writing down the partial fraction expansion for the above 

MCT 2 /(a + b+c) 


*A(z ‘)$ ee (z) 
zP~(z) _ + 


(z-1) 


(A-3) 


P(z) = - 


K 2 N q T 3 


(z + l) 2 

(z-1) 2 


1 + r ■ 


(Z - l ) 4 


K 2 N q T 3 


r = 


XT 

An 


(z 6 - 2z 5 + (r - 1 > 4 + (2 r + 4)z 3 + (r - 1> 2 - 2z + 1} 
(z-1) 6 
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Factorization of P(z ) results in 


P(z) = 


)K 2 N 0 T 3 


az 


+ bz 2 + cz + d 

(*- l) 3 


in*)i + 


x/rr 3 i 

2 (a + Z>+c+</) 2 


{(7tf + 5b + 3c + d)z - (5a + 3b + c - tf)} 

(z-1) 2 


X 



+ bz 2 + cz 1 

r 1 - 1) 3 



(A-4) 


where the factors of P(z) above represent P + (z) and P~(z) 
respectively. Comparison of the two alternative expressions 
yields the following set of equations for the solution of a, b> 
c and d. 


(A -7) 


Substitution of Eq. (A-7) and the expression for P~(z) from 
Eq. (A4) into Eq. (6) provides an expression for the optimum 
close loop filter W Q (z), 



ad 
ac + bd 
ab + be + cd 
a 2 + b 2 + c 2 + d 2 



= (r-1) 

= (2r + 4) 


(A’5) 


Now, 


1 ( h o z -V(z-Oz 

(a + b + c + d) 2 (az 3 + bz 2 +cz +d) 

h Q = (7a + 5b + 3c+d) 
A, = (5a + 36 + c - 0 


r (z) = 

zP~(z) 


From Eq. (A-5) and the expansion for (a + b + c + d) 2 , it fol- 
lows that {a + Z? + c + d) 2 = 4r. Substitution of this in the 
above leads to the expression for W Q (z) given in Section IV. 


(z + l)z 3 1 

(z - l) 2 (a + bz + cz 2 + dz 3 ) 


(A-6) 


Straightforward substitution yields the optimum loop fil- 
ter F(z) as, 


Writing down the partial fraction expansion of the above 
rational function of z and recognizing that the roots of 
a + bz +cz 2 + dz 3 = 0 lie outside the unit circle, 


Ayvcz- 1 )*^) 


zP~(z) 






(z - l) 2 (z - 1) 


A = (z-1) 2 Y(z)\ 


\KT 3 


I z-1 


(a + b + c + d) 




2 = 1 


(a + b + c + tf) 2 


Substitution of A and B , and a little simplification yields, 



(V-V ( z “ 

4az 4 + 46z 3 + (4c - h Q )z 2 + (4 d -h Q + h { )z + h l 


Factorization of the denominator polynomial and cancelling 
the factor (z-1) common to both the numerator and denomi- 
nator, 


F(z) 


2 

KT 


X 


Qi 0 z-h x )z 2 
(z-1) {4az 2 + (Sa + 4b)z + (5a + 3b + c - d)} 
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Solution of the Filter Coefficients a, b, c, d. For any given 
value of r, the system of simultaneous non-linear equations, 
Eq. (A-5) must be solved for a , b, c and d . In fact, as_discussed 
earlier, it is sufficient to solve the set (18) for a, b y c first and 
then obtain a , Z?, c, and d from 

a ~ a 

b = b + 0.9 a 
c " c + 0.9 c 
d = 0.9c 


It turns out from the stability considerations that |c| > 
|c| and without loss of any generality we may assume a > 0. 
Thus, to satisfy the first equation of (18), a > 1 . Since we are 
interested in solving the set (18) for a range of values of r, an 
equivalent but simpler approach is to assume a range of a and 
then solve for b , c, and r from the following: 

c = 1 la 

b = -4/(iz + c) 

r = (a 2 +b 2 +c 2 - 6) 1 / 2 
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A Laser Plotting System for VLSI Chip Layouts 

J. A. Harding and L. J. Deutsch 
Communications Systems Research Section 


One of the most time consuming facets of custom Very Large Scale Integration 
(VLSI) design is obtaining hardcopy plots of the mask geometries of cells and chips. 
The traditional method of generating these plots is to use a multicolor pen plotter. Pen 
plotters are inherently slow and the plotting speed increases linearly with the number of 
edges that must be plotted. A moderate custom chip design atJPL now consists of more 
than 200,000 such edges and can take as much as eight hours to plot using a pen plotter. 
This paper describes software that was written at JPL to produce similar plots using a 
laser printer. It is shown that, for rather small layouts, the laser printer can provide nearly 
instantaneous turnaround. For moderate to large chip designs, the laser printer provides 
a factor of five or more improvement in speed over pen plotting. 


I. Introduction 

The design of a custom or semicustom Very Large Scale 
Integrated (VLSI) chip involves many Computer Aided Design 
(CAD) tools. A UNIX-based CAD system for VLSI design was 
described in Ref. 1 . The process is centered around the crea- 
tion of a computer file that describes the geometry for each 
mask layer in the fabrication process. This data is often 
referred to as a layout. Caltech Intermediate Format (CIF) 
(Ref. 2) is simply a standardized syntax for the description of 
such geometry. 

There are several stages in the design process when it is 
preferable that the designer have a hardcopy plot of a layout 
file. One of these stages is called floorplanning. In floor- 
planning, layouts of subcells are arranged into a larger system. 
This involves a great deal of rearranging of the subcells. Hard- 
copy plots help the designer understand the relative sizes, 
interconnection requirements, and shapes of the subcells. 


Hardcopy plots are also useful in the chip simulation pro- 
cess. If the plots have node labels on them, then the designer 
can use them to follow a circuit’s behavior during simulation. 

Plots are sometimes helpful even while performing layout 
editing — even when using a graphical layout editor such as 
caesar (Ref. 3). These plots help the designer see areas of the 
chip that are too large to be viewed on the graphics screen 
at one time. 

All of these applicatons of hardcopy cifplots are only 
feasible if the plots can be generated in a relatively short 
time. Currently, cifplots are generated on mechanical pen 
plotters. These devices are inherently slow and are only 
useful in the design process for very small cells. The turn- 
around time for generating pen plots is, as a rule, only accept- 
able for layouts of cells with up to around 50 transistors. 
Larger cells require more time to plot than is practical for 
applications other than producing documents. 


81 



The time that it takes a pen plotter to produce a cifplot is 
roughly proportional to the number of lines that it must plot 
multiplied by the length of these lines (this is the arclength 
of the CIF File). Most pen plotting programs for cifplotting 
use a different color pen for each mask layer. This has definite 
advantages. However, only the outline of each geometric 
shape is plotted. This means that if the plot is even moderately 
dense, it is often difficult to tell where the interior and exterior 
regions of these shapes really are. Many pen plotting programs 
are not capable of placing text on the plot. This means that 
electrical nodes cannot be labeled and the plot will be of 
limited use during the chip simulation process. Finally, most 
existing software for cifplotting — regardless of the output 
device — is not technology independent. This means that 
the programs are limited to a small number of fabrication 
technologies and therefore they will always become obsolete. 

With the complexity of JPL in-house chip designs increasing 
by about a factor of five every year, it became necessary this 
year to address the hardcopy plotting issue. In an attempt to 
solve most of the above problems, a laser printer was pur- 
chased. The particular printer is a Quality Micro Systems 
(QMS) Lasergrafix 2400. The QMS printer is capable of pro- 
ducing high quality text at a rate of 24 pages each minute. 
It also comes with special hardware and firmware for per- 
forming many complex graphics functions. It may be operated 
in a pure vector mode similar to that of a pen plotter only 
many times faster. The resolution of the QMS printer is 300 
points per inch in both axes. It uses 8.5 in. X 11 in. plain 
paper. 

A laser printer is a device that uses a plain paper copying 
process to produce rasterized hardcopy output. In the case 
of the QMS printer, the method is the Xerographic copying 
process. In fact, the QMS is based on a standard Xerox brand 
copier. A laser is used to scan input pixel information onto a 
drum. A sheet of plain paper is passed over the drum and the 
pixels that will be black are heated with respect to the rest of 
the paper. A dry toner is then applied to the paper. It fixes 
to the paper only where the paper has been heated by the 
drum. The remaining toner is then removed resulting in a 
finished page. 

Software was written to produce cifplots on the QMS 
printer. The software is called Laser . Plots generated by 
Laser are produced in black and white. This is a disadvantage 
over the pen plotters. However, the geometric shapes may be 
filled in with different hatching styles. This gives the same 
functionality as the different colors, and it also solves the 
problem of distinguishing interior and exterior regions in 
complex chip plots. Laser is completely technology inde- 
pendent. The user may use a technology description file in a 
standard system library or one of original design. By using the 


QMS printer’s text capability, L^ser can also label electrical 
nodes. Finally, Laser works much faster than programs that 
use pen plotters. It is now possible to obtain hardcopy cifplots 
of chips with hundreds of transistors in a matter of minutes. 
In fact, since the time required to produce Laser plots is 
roughly proportional to the number of geometric shapes 
rather than arc length or number of edges, the Laser printer 
has a distinct speed advantage over pen plotters. 

Since all the designs that are produced on the UNIX -based 
CAD system are of Manhattan geometry (i.e., they consist 
of rectangles that are all aligned with the x and y axes) the 
ability to plot non-Manhattan CIF was not programmed into 
Laser. Only a minor modification would be required to allow 
Laser to plot non-Manhattan (sometimes called Boston) 
geometry. 

II. The Laser Cifplotting Software 

Laser actually consists of several individual programs that 
are controlled through a command file (called a shell script in 
UNIX). The command file is written in the UNIX C-shell. It 
parses the command line and routes the appropriate data 
through the various programs. The user invokes Laser by 
typing the word Laser. In addition, the user may specify 
certain options on the command line. 

There are currently three options supported on the com- 
mand line. First, a technology description file may be speci- 
fied. The default technology is currently NMOS. The Laser 
command file first searches the system’s technology library 
for the requested file. If it is not found there, then the user’s 
current directory is searched. In this way, each user may have 
a set of unique technology description files. If a designer were 
working with an NMOS design, for example, but wished to 
use a hatching style for the layers that is different than the 
one in the system library, then a technology description file 
with a name such as nmos.my-own could be created and 
placed in the user’s own directory. 

Another option allows the user to specify which layers 
should be filled in and which should be plotted as outlines 
only. This option is provided to allow even quicker turnaround 
time for simple cell layouts. Since node labels are treated like 
a mask layer in the Laser program, the user could use this 
option to eliminate the plotting of labels. This might be neces- 
sary on very complex plots in which the labels would overlap 
each other. Laser creates a legend on the finished plot that 
indicates the hatch styles that are used for each non-deleted 
layer. 

The last option that the user may request on the command 
line is the title option. The user may use this option to pass a 
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line of text to the Laser program for use as a large headline- 
style title that will be placed at the top of the plot. 

The first program that is called by the Laser command file 
is a University of California at Berkeley program called 
cifflatten. CIF is a hierarchical description language. This 
means that cells that are used many times in a chip design 
need only be described once at a geometric level. Further 
references to that cell may then be specified by calls to this 
definition. Cifflatten takes a CIF file as an input and pro- 
duces a CIF file that describes the same design but with all 
the hierarchy removed. This “simple” CIF is easier to process 
in subsequent parts of the program. Cifflatten was slightly 
modified to allow the calculation of the overall geometric 
dimensions of the chip design at the same time as the flatten- 
ning operation. This information is needed to scale the plot 
for final output on a hardcopy page. 

After flattenning, the CIF information is processed by a 
program called qmscif. Qmscif is a Pascal program that was 
written here at JPL. It produces a file that contains the control 
sequences for the QMS printer that are needed to produce the 
plot. QMS calls this set of codes the QUIC programming 
language. The QUIC language has graphics primitives for 
vector plotting, box drawing, and labeling. It even has a simple 
looping ability that is used in qmscif to produce the various 
hatch styles for different VLSI layers. 

The QUIC file is placed in the UNIX spooling system for 
subsequent downloading to the QMS printer. Laser is fully 
integrated onto the UNIX spooling environment. This means 
that cifplotting, laser text printing, and standard (dot matrix) 
text printing are all under one set of system controls. 

When the QUIC file reaches the top of the spooler’s queue, 
it is sent to the QMS printer. A plot is then generated. 

III. Some Benchmark Tests 

In order to determine the functionality and relative per- 
formance improvement over pen plotting, a set of CIF files 
that covers a wide range of typical designs was assembled. 
Many of these CIF files come from designs that were per- 
formed for projects within the DSN Advanced Systems Pro- 
gram. Table 1 shows some of the important statistics of these 
designs. 

The names of the designs are shown in the first column of 
the table. Shiftcell is a single half-bit stage in a dynamic 
NMOS shift register. It is the simplest of the designs that 
were tested. Fa is a full adder. It is typical of the complexity 
of a single low-level subcell in a chip design. D is a d-type 
flip-flop. It comes from a library of standard cells that are 


based on the Sandia National Laboratory radiation-hardened 
CMOS fabrication process. Lag is a bit slice through a three- 
level complex correlator with phase rotation. It is typical of 
an intermediate level subcell, and it contains several cells of 
the complexity of fa. Conv2 is a small complete chip. It is 
the layout of the Multicode Convolutional Encoder chip 
(Ref. 4). Rsint is the layout of an 8-bit (255, 223) Reed- 
Solomon encoder with interleaving (Ref. 5). It is an example 
of a chip of moderate complexity. No chips of higher com- 
plexity than rsint were benchmarked because the time for 
pen plotting would have been prohibitive. 

The third column of the table shows the number of tran- 
sistors in each design. It gives a good indication of the relative 
complexity of the designs. It is important to note that the 
increase in complexity between conv2 and rsint is typical 
of the trend over the two-year time period that this represents 
here at JPL. A typical large chip that is designed in-house 
today contains between 30,000 and 60,000 transistors. 

The fourth column indicates the number of rectangles in 
the design. Since all these designs are of Manhattan geometry, 
this is actually the number of individual shapes in the design. 
The Laser plotting speed should be roughly proportional to 
this number. 

The next column is labeled Normalized Arc Length . This 
number, when divided by 1,000, is actually the number of 
millimeters of perimeter for all the rectangles that would be 
measured on the fabricated chip using a standard fabrication 
scaling (X - 2.0ju). The time for pen plotting should be pro- 
portional to this number. Notice that ratio of the largest 
to the smallest number of rectangles is about 3,200 while the 
similar ratio in arc length is about 4,300. This already indi- 
cates a probable speed advantage for Laser plotting, even if 
the time to plot a shape is the same on the two devices. 

The last column in the table indicates the regularity ratio . 
This is a measure of the hierarchical complexity of the design. 
It is actually the number of rectangles in the design divided 
by the number of rectangles defined explicitly (rather than by 
calls to cell definitions) in the CIF file. A value of 1.0 means 
that there is no hierarchy in the CIF. The higher the ratio, 
the more regular the design is. Rsint is a very regular design 
that contains large blocks of identical cells. The regularity 
ratio is an indication of the amount of computation needed 
to perform the CIF flattenning operation. 

These designs were plotted using both the pen plotter and 
the QMS Laser printer. The plots were performed on a Digital 
Equipment Corporation VAX 11/750 computer with a load 
average of approximately 3.0 (moderately heavy usage). The 
plotting and processing times (actual elapsed time) were both 
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recorded. The processing time for the pen plotter is not 
important since it is negligible compared to the mechanical 
plotting time. Also, since the pen plotter is not a spooled 
device, it is run directly by the software and the processing 
time cannot be distinguished. 

The results of these timing tests are recorded in Table 2. 
The pen plots of the six CIF files appear in Figs. 1 through 6. 
The Laser plots for the same files appear in Figs. 7 through 12. 

IV. Conclusions 

The first thing that is evident from the figures is that the 
Laser plots are much easier to read. This is because the QMS 
printer fills in the various layers. The layer types and inter- 
sections of layers are all easily discernible. Even though the 
pen plots were originally in color, the color effect is much 
less pleasing to the eye than the solid regions produced by the 
Laser printer. 

Table 2 shows the processor and plotting times required 
for both the pen and Laser plots. Notice that in every case, 
the Laser plot took less time to generate than the correspond- 
ing pen plot. Even in the smallest CIF file (shiftcell) there was 
an almost three-fold increase in performance. In fact, the ratio 


of Laser plotting time to pen plotting time increases with the 
complexity of the CIF file as expected. 

V. Future Work 

Some improvements will be made in Laser during the next 
year. One of these will be to add the ability to produce mosaic 
plots. Since the QMS printer is limited to a paper size of 
8.5 in. X 11 in., large CIF files for which the designer wishes 
to see a reasonable amount of detail will have to be generated 
on multiple pages. These could then be pasted together to 
produce one large plot. This technique is also used with the 
current pen plotter which is limited to 11 in. X 14 in. paper. 

In order to make the software run faster, the code in 
qmscif should be merged with cifflatten so that multiple 
interrogations of very large data files need not occur during 
processing. Another advantage of doing this would be to 
allow some cells of a CIF file to have only their outlines 
plotted. 

As costs become less prohibitive, a color Laser printer 
could be acquired. This would enhance the plots even more 
and allow many more layer types to be plotted on a page 
without confusion. 
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Table 1. Statistics for benchmark test layouts 


Cell Name 

Fabrication 

Technology 

Number of 
Transistors 

Number of 
Rectangles 

Normalized 
Arc Length 

Regularity 

Ratio 

shiftcell 

NMOS 

31 

17 

324 

1.0 

fa 

NMOS 

18 

114 

2,378 

1.0 

d 

CMOS 

25 

288 

11,364 

1.0 

lag 

NMOS 

184 

1676 

44,956 

2.6 

conv2 

NMOS 

453 

5646 

186,632 

4.0 

rsint 

NMOS 

8918 

54182 

1,405,182 

27.1 


Table 2. Results of benchmark timing tests for pen and laser CIF plotting 


Cell Name 

Time for 
CIF 

Processing 

Time to 
Download to 
Laser Printer 

Total Time 
for Laser 
Plotting 

Time for 
Pen 

Improvement 

Relative 

Speed 

shiftcell 

0:13 

0:16 

0:39 

1:05 

2.7 

fa 

0:23 

0:38 

1:01 

3:46 

3.7 

d 

0:46 

1:12 

1:58 

6:58 

3.5 

lag 

1:48 

1:28 

2:36 

13:24 

5.2 

conv2 

11:10 

3:38 

14:48 

42:40 

2.9 

rsint 

37.40 

26.36 

1:03:56 

5:51:00 

5.5 

Note: All times are in the form hours: minutes:seconds 




Fig. 1. Pen cifplot of shiftcell 



Fig. 2. Pen cifplot of fa 
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Fig. 1 1 . Laser clfplot of conv2 
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Fig. 12. Laser cifplot of rsmt 
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Mark IV-A DSCC Telemetry System Description 

D. L. Ross 

DSN Systems Engineering 


This article provides an update to the description of the Deep Space Communications 
Complex (DSCC) portion of the MK IV-A Telemetry System. This system is currently 
being implemented at all signal processing centers . The Mark III Telemetry System is the 
predecessor of the Mark IV-A System. 


I. Introduction 

Implementation of the DSN MK IV-A Telemetry System 
(Ref. 1) has been proceeding for the past two years and is 
nearly complete at all signal processing centers. The Deep 
Space Communications Complex (DSCC) portion of the 
DSN Telemetry System has been changed in two major ways 
as a result of the Mark IV-A DSN implementation. The 
Mark III Telemetry System is the predecessor of the Mark IV-A 
System and is described in Ref. 2. 

(1) One 34-meter antenna has been added to each DSCC 
at Goldstone and Canberra. A 34-meter antenna will 
also be added at the Madrid Complex in June 1987. 
The arraying of this additional antenna with the 
existing 64- and 34-meter antennas at X-band will 
provide a relative gain of 1.84 dB (assuming a 0.2 dB 
array loss) as compared to a single 64-meter antenna, 
or a relative gain of 1 .07 dB as compared to the array- 
ing of the existing 64- and 34-meter antennas. To 
accomplish this, equipment has been added to provide 
baseband combining of signals from the three antennas. 

(2) The telemetry system has been configured to support 
three missions simultaneously, with one or two of 
them being highly elliptical earth orbiters. Highly 
ellipitical orbiter (HEO) missions will have coded data 


at rates up to 211.2 ksps, manchester coded, modu- 
lated directly on the carrier. 

Implementation of these changes, combined with previous 
capabilities, has prepared the network to support Deep Space 
and HEO missions. 

The Deep Space missions are the following: 

Pioneers 6 through 9 

Pioneers 10 and 11 

Pioneer Venus 

Voyager 

Galileo 

Ulysses 

Giotto 

The HEO missions are the following: 

ICE (International Cometary Explorer) 

AMPTE (Active Magnetospheric Particle Tracer Experiment) 
CCE (charge composition Explorer) 
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IRM (Ion Release Module) 

UKS (United Kingdom Spacecraft) 

II. Key Characteristics 

The key characteristics of the DSCC portion of the Mark 
IV-A Telemetry System are: 

(1) Coded data at rates up to 250 kilobits per second 
(kbps). 

(2) Baseband combining for up to 7 antennas. 

(3) Four complete groups of telemetry equipment at each 
complex, each with the capacity to support one of the 
above missions. 

(4) Demodulation of Manchester coded (Bi0-L) or NRZ-L 
data modulated directly on the carrier. 

(5) Maximum likelihood decoding of short-constraint- 
length convolutional codes and sequential decoding of 
long-constraint-length convolutional codes. 

(6) Precise measurement of received signal level and system 
noise temperature. 

(7) Centralized control by (and real-time reporting to) the 
Monitor and Control Subsystem. 

(8) Production of digital telemetry Original Data Record 
(ODR) at each telemetry group with playback via 
local manual control or in automatic response to GCF 
inputs; reduced playback rate for higher data rates as 
required. 


The handling of increased data rates and demodulation 
of NRZ or biphase data modulated directly on the carrier 
responds to a requirement for telemetry support of HEO 
spacecraft. Baseband combining provides for improved sen- 
sitivity to high data rate X-band signals in support of deep 
space telemetry and is driven by the Voyager project require- 
ment for support of 29.9 kbps at Uranus encounter. The ICE 
mission also requires three-input baseband combining; two 
signals from the 64-m antenna (one right circularly polarized, 
one left) and one from the standard 34-m antenna. This will 
enable the data rate to be maintained at 1024 bps during 
encounter with the Giacobini-Zinner comet. New equipment 
for baseband combining allows a data rate increase to 250 
kbps from the previous peak of 135 kbps. The provision for 
four groups of telemetry equipment at each SPC responds to 
the requirement to provide telemetry support to three proj- 
ects concurrently. 


III. Project Data Rate and Coding 
Requirements 

HEO missions are compatible with the existing DSN capa- 
bilities. This is illustrated in Table 1, which defines the single 
link data handling requirements for the HEO projects included 
in the Mark IV-A mission set. A telemetry single link can be 
defined as all of the functional elements, from the antenna(s) 
through an SPC telemetry group, that have been selected for 
support of a project. The requirement to detect Biphase 
(Manchester coding) modulation directly on the carrier was 
met during the Mark IV-A implementation. 

Requirements for new and existing deep space missions are 
listed in Table 2. The new missions to be supported during 
Mark IV-A are Galileo, Ulysses and Giotto. The next section 
shows how HEO and deep space mission requirements will be 
met. 


IV. DSCC Conceptual Description 

The DSCC block diagram in Fig. 1 provides a conceptual 
description of the portion of the Mark IV-A Telemetry 
System to be located at the DSCC. At each complex there 
will be one 64-meter antenna and two 34-meter antennas 
(with the exception of the second Madrid 34-m antenna as 
noted earlier). The 64-meter and 34-meter standard antennas 
will be able to receive an S-band plus an X-band carrier simul- 
taneously. The 34-meter High-Efficiency antennas will receive 
one X-band carrier; they are not useful for receiving S-band 
telemetry carriers for deep space missions because of high 
system noise temperature (115 K). Table 3 gives the RF recep- 
tion characteristics for these antennas and indicates the 
distribution of masers and FETs. The 64-meter antennas will 
be equipped exclusively with masers whereas the 34-meter 
antennas will also have FETs. At the 34-meter antennas 
the masers will provide deep space support, and the S-band 
FETs will support HEOs with their broader (2200-2300 MHz) 
reception bandwidth requirements. New Block II-A X-band 
masers have been provided for the 64-m antennas at Gold- 
stone and Canberra, giving lower X-band system temperatures 
than in the Mark III DSN. Also, the new 34-meter high- 
efficiency antennas will provide increased X-band gain com- 
pared with the existing 34-meter standard antennas. 

Existing Block III and Block IV receivers will be used to 
receive and detect baseband signals. The Block III receivers 
were modified to support HEO frequencies and provide a 
broad (4 MHz) baseband output to the Telemetry Subsystem. 
The Telemetry Subsystem is arranged to provide four telem- 
etry groups, any of which can process data from any receiver 
and therefore from either an HEO or deep space spacecraft. 
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All groups will include the Mark III Maximum Likelihood 
Convolutional Decoder (MCD) and Telemetry Processor 
Assembly (TP A). The MCDs were modified to change the 
node synchronization algorithm to achieve better perform- 
ance at low signal-to-noise ratio for Voyager Uranus encounter. 
Telemetry Groups 3 and 4 are equipped with a new Baseband 
Assembly (BBA) which will include the functions of baseband 
combining, subcarrier demodulation and symbol synchroniza- 
tion. Figure 2 is a functional block diagram of the BBA. 
Any combination of receiver outputs can be input to either 
subcarrier demodulator; or any single receiver output can be 
routed to either subcarrier demodulator, bypassing the com- 
bining function. The monitor and control function is per- 
formed from the TPA with no manual intervention required. 
The BBA is designed to accommodate NRZ-L, NRZ-M or 
Bi0-L symbol formats, subcarriers up to 2 MHz and data 
rates from 4 s/s to 1 Ms/s with subcarrier, up to 4 Ms/s (NRZ) 
without subcarrier or up to 2 Ms/s for Bi0-L. Operation with 
the BBA, including combining the 64-m and two 34-m antenna 
basebands, will result in a nominal system degradation at 
the highest data rates of about 0.3 dB. This includes an allow- 
ance for waveform, spectrum correlation and symbol timing 
losses and represents an improvement over the Mark III 
system of several tenths of a dB. Telemetry Groups 1 and 2 
include modified Mark III Subcarrier Demodulator Assemblies 
(SDA) and Symbol Synchronizer Assemblies (SSA) as well 
as an MCD and TPA. Therefore, hardware in Group 1 and 
Group 2 closely resembles the Mark III Telemetry Subsystem. 
The SSAs were modified to decode Bi0-L (Manchester coded) 
data so that Groups 1 and 2 can support HEO missions without 


using Spaceflight Tracking and Data Network (STDN) bit 
synchronizers as proposed in Ref. 3. New software was pro- 
vided for the TPAs. The 64- and 34-meter antennas can be 
arrayed by combining baseband signals and performing sub- 
carrier demodulation and symbol synchronization in the 
BBA in either Telemetry Group 3 or Telemetry Group 4. The 
combined signal is then decoded in the Maximum Likelihood 
Convolutional Decoder and formatted for transmission to JPL 
in the Telemetry Processor Assembly. When combining is not 
required, outputs from an antenna may also be routed to a 
Subcarrier Demodulator Assembly (Groups 1 and 2) or to 
either Baseband Assemblies (Groups 3 and 4). 

Any of the telemetry equipment groups can accept two 
data streams. In any group, one data stream is processed by 
Channel 1 and one by Channel 2. The performance parameters 
for Channels 1 and 2 are listed in Tables 4 and 5, respectively. 
When comparing Table 1 with Tables 4 and 5, note that 
Data Stream 1 in Table 1 is processed by Channel 1, while 
Data Stream 2 is processed in Channel 2. Also note that 
Groups 3 and 4 provide higher data rate capability (for exam- 
ple, for convolutionally coded data: 250 kb/s vs 135 kb/s) and 
higher subcarrier frequency capability (2 MHz vs 1 MHz). 
This improvement is due to the BBA and wider receiver 
passband. However, the overall system will not support the 
highest BB A/receiver data rate capability until further improve- 
ments are made, including a wider bandwidth in the receivers, 
MCD replacement, provision for high rate recording, and quick 
look. Future planned missions will require these additional 
improvements, as well as adding a Reed-Solomon Decoder. 
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Table 1. Single link requirements for HEO missions 


Mission 

Data Stream 1 

Data Stream 2 

ICE 

Convolutionally coded; 

K=24, R= 1/2; NRZ-L; 64 b/s; 
Subcarrier: 1024 Hz 

or 

Convolutionally coded; 

K= 24, R=l/2; 512 to 2048 b/s: Bi0-L 


AMPTE-CCE 

Convolutionally coded; 

Uncoded NRZ-L; 3300 b/s; 


K=l,R=l/2;Buf-h 105,600 b/s 

subcarrier: 429 kHz 

AMPTE-IRM 

Convolutionally coded; 

AT=7, R= 1/2; NRZ-L; 1.024 kb/s; 
2.048 kb/s, 4.096 kb/s, or 8.192 kb/s; 
subcarrier: 131,072 Hz 


AMPTE-UKS 

Convolutionally coded; 

K= 7, /?= 1/2, or uncoded; B i^-L ; 

1024 b/s, 2048 b/s, 4096 b/s, 8192 b/s, 
16384 b/s, 32768 b/s 




Table 2. Single link requirements for deep space missions 


Mission 

Data Stream 1 

Data Stream 2 

Pioneers 6-9 

Uncoded; NRZ-M; 8 to 512 b/s; subcarrier: 
512 Hz for 8 to 64 b/s, 2048 Hz for 128 b/s; 
S-band 


Pioneers 10/11 

Uncoded; NRZ-L, 8 to 2048 b/s; subcarrier: 
32.768 kHz; S-band 

or 

Convolutionally coded; 

*=32, *=1/2, NRZ-L; 8 to 2048 b/s; 
subcarrier; 32.768 kHz; S-band 


Pioneer Venus 

Uncoded; NRZ-L; 8 to 4096 b/s; 
subcarrier: 16 kHz; S-band 

or 

Convolutionally coded; 

*=32, *= 1/2; NRZ-L; 8 to 2048 b/s; 
subcarrier: 16 kHz; S-band 


Voyager 

Convolutionally coded; 

Uncoded; NRZ-L; 46.667 b/s; 


K=T, R=l/2; NRZ-L; 10 to 115,000 b/s; 

subcarrier: 360kHz; combined 


combined X-band; subcarrier: 360 kHz 

X-band 

or 

Uncoded; NRZ-L; 46 .667 b/s; 
subcarrier: 22.5 kHz; S-band 

Galileo 

Convolutionally coded; 

Uncoded; NRZ-L 40 b/s; 


*= 7, *=1/2; NRZ-L up to 134.4 kb/s; 
subcarrier; 360 kHz; combined X-band 

or 

Convolutionally coded; 

*=7, *=1/2; NRZ-L; up to 40 kb/s; 
subcarrier: 22.5 kHz for data rates up to 
7.68 kb/s, 360 kHz for rates >7.68 kb/s; 
S-band 

subcarrier: 22.5 kHz; S-band 

Ulysses 

Convolutionally coded; 

NRZ-L; *=7, *=1/2; 128 b/s to 8,192 b/s; 
subcarrier: 65,536 Hz for rates up to 
1024 b/s, 131,072 Hz for rates of 2,048 b/s 
or greater; X-band 


Giotto* 

Convolutionally coded; 

Uncoded; NRZ-L; 


NRZ-L ;*=7, *=1/2; 

Subcarrier: 46.080 kHz for 


Subcarrier: 46.080 kHz for data rate of 

data rate of 360 b/s; S- or 


360 b/s, 276.480 kHz for data rates of 
5,760 b/s, 23,040 b/s and 46,080 b/s; 
S- or X-band 

X-band 


or 

or 


Reed-Solomon and convolutionally coded; 

Reed-Solomon coded; NRZ-L; 


NRZ-L;*=7,*=l/2; 

Subcarrier: 276,480 kHz for 


Subcarrier: 276.480 kHz for data rates of 

data rates of 5,760 b/s, 23,040 


5,760 b/s, 23,040 b/s, and 46,080 b/s; 

b/s, and 46,080 b/s; S- or 


S- or X-band 

X-band 

*Reed-Solomon data are not presently decoded by the DSN; only convolutionally encoded data are 

decoded by the DSN. 




Table 3. RF reception characteristics 




Antenna 


Parameter 

64-meter 

34-meter 

Standard 

34-meter 

High-Efficiency 

Frequency Range, MHz 

S-band 

2270-2300 

2200-2300 

2200-2300 

X-band 

8400-8440 

8400-8500 

8400-8500 

Gain, dBi 

S-band 

61.7 +0 * 3 

56.1 +0 - 3 

55.8 +0 '° 


- 0.4 

- 0.7 

- 0.5 

X-band 

72.1 + °‘ 6 

66.2 + °' 6 

67.3 + °- 5 

- 0.6 

- 0.6 

- 0.8 

System Noise Temperature, K 
Zenith 

S-band with maser 

Diplex 

18.5 ±3 

27.5 ±2.5 


Listen-only 

14.5 ±2 

21.5 ±2.5 


S-band with FET 

Diplex 
Listen only 
X-band with maser 

20 ±3 

130 ±10 
25.0 ±2.5 

115 ±10 
18.5 ±2 


Table 4. DSCC telemetry s/s channel capabilities (telemetry groups 1 and 2) 


Functions 

Channel 1 

Channel 2 

Baseband Combining 

N/A 

N/A 

Subcarrier Demodulation 

100 Hz to 1 MHz, 
square wave or sine wave 

100 Hz to 1 MHz, 
squarewave or sine wave 

Symbol Synchronization 

6 s/s to 268.8 ks/s 

6 s/s to 268.8 ks/s 

Data Format 

NRZ-L, NRZ-M, Bi0-L 

NRZ-L, NRZ-M, Bifr-L 

Sequential Decoding 

A=24 or 32;/?=l/2; 
frame length selectable; 
16 s/s to 20 ks/s 

N/A 

Maximum Likelihood 
Convolutional Decoding 

K=l;R=l/2 or 1/3 
10 b/s to 134.4 kb/s 

N/A 

Uncoded 

6 b/s to 268.8 kb/s* 

6 b/s to 268.8 kb/s* 

* Record only with non-real- time playback above 250 kbps 



Table 5. DSCC telemetry s/s channel capabilities (telemetry groups 3 and 4) 


Functions 

Channel 1 

Channel 2 

Baseband Combining 

Up to seven basebands 

N/A 

Subcarrier Demodulation 

10 kHz to 2 MHz, 
squarewave or sine wave 

10 kHz to 2 MHz, 
squarewave or sine wave 

Symbol Synchronization 

4 s/s to 4 Ms/s 

4 s/s to 4 Ms/s 

Data Format 

NRZ-L, NRZ-M, Bi</>-L 

NRZ-L, NRZ-M, Bi0-L 

Sequential Decoding 

K=24 or 32;/?=l/2; 
frame length selectable; 
16 s/s to 20 ks/s 

N/A 

Maximum Likelihood 
Convolutional Decoding 

/f=7;/?=l/2 or 1/3 
10 bps to 250 kbps* 

N/A 

Uncoded 

4 bps to 500 kbps* 

4 bps to 500 kbps* 

♦Record only with non-real- time playback above 250 kbps 




Fig. 1. Telemetry System: DSCC block diagram 
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Fig. 2. Baseband Assembly functional block diagram 
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The VLBI modeling software packages CALC 6.0 (GSFC) and MASTERFIT (JPL) 
are compared in some detail Theoretical model delays are calculated for a set of 120 
fictitious observations which involve a variety of sources , baselines , and antennas. 
Discrepancies between the total delays given by the two programs are of the order of 
2 cm (RMS). The modeling of antenna offsets appears to account for approximately 
half of this difference. Relativistic bending contributions to the delay differ by 3 cm 
(RMS), and there appears to be some mutual cancellation of errors involving antenna 
offsets , bending , and the effects of the two different Solar System ephemerides employed 
by CALC and MASTERFIT. This cancellation has not been completely characterized in 
the present study. 


I. Introduction 

During the past decade, parallel and independent develop- 
ment of the VLBI technique for geodesy and astrometry has 
taken place on the U.S. East and West coasts. The respective 
focal points for software development are the Goddard Space 
Flight Center (GSFC) and Jet Propulsion Laboratory (JPL). 
The corresponding modeling software packages are known by 
the names of CALC (Refs. 1, 2) and MASTERFIT (Ref. 3). 
Station location estimates have reached the point of 1-cm 
formal errors. In order to gain assurance that there are no sig- 
nificant differences between the modeling software at the 
centimeter level, we undertook a detailed comparison. Previ- 
ous efforts (Ref. 4; M. G. Roth, private communication, 
1981) were not comprehensive enough to provide detailed 


assessments of model differences at this level. At the time that 
this study was initiated (late 1984), there still existed discrep- 
ancies as large as 10 cm. Most of these appear to have been 
eliminated by the implementation of the Yoder short-period 
tidal UT1 corrections and the Shapiro relativistic corrections 
in going from version 5.0 to 6.0 of CALC. 

The method we employ entails comparison of model 
delays yielded by CALC and MASTERFIT. Both are the 
versions in use on the GSFC HP 1000 and JPL VAX 11/785 
computers in the Spring of 1985, identified as CALC 6.0 and 
MFIT.EXE; 333, respectively. The MASTERFIT models, with 
minor exceptions, correspond to those described by Fanselow 
and Sovers (Ref. 3). A set of 120 fictitious (“benchmark”) 
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observations was generated, employing hourly alternating 
observations of three sources with five baselines on April 1, 
1982. 

If care is taken to make the two models identical to the 
extent permitted by the existing code, differences of calcu- 
lated delays are found to be 9-50 ps (3-15 mm), even for 
baselines nearly the length of an Earth diameter. To some 
extent, this agreement results from partial cancellation of 
larger discrepancies in parts of the models. In particular, 
apparent differences as large as 250 ps (8 cm) in the relativ- 
istic part of the delay remain unexplained. The comparison 
process uncovered one centimeter-level bug in MASTERFIT, 
and slight inadequacies of two models in CALC and MASTER- 
FIT. The former involved inconsistent coordinate systems used 
to estimate the pole tide, while the latter concerned a singu- 
larity in the correction of the elevation angle for estimating 
the antenna axis offset effect in CALC, and corrections for a 
nonspherical Earth in the local to geocentric transformations 
of tidal displacements in MASTERFIT. 

It is emphasized that the present benchmark study does not 
address delay rates, observable partials, or least-squares param- 
eter estimation. We hope to compare all of these aspects of the 
software in the future. Indirect evidence from a variety of fits 
to real data, however, implies that no serious discrepancies 
exist. For example, universal time and polar motion values 
derived from independent experiments by the two groups 
are in good agreement with each other, as well as with the BIH 
compilation (Ref. 5); a transcontinental baseline measurement 
agrees at the centimeter level (Refs. 6,7); both groups obtain 
a value close to 1.0 for the parametrized post -Newtonian 
theory gamma factor (Refs. 8, 7); positions of extragalactic 
radio sources derived from independent measurements by 
GSFC and JPL agree essentially within formal error esti- 
mates (Ref. 9). 

Previous attempts at software comparison were not strictly 
analogous to the present study. Fliegel (Ref. 4) did an overall 
comparison of baseline results for Mobile VLBI experiments, 
but did not isolate components of the model. M. G. Roth 
(private communication, 1981) did investigate details of the 
JPL and GSFC models, but abandoned the comparison at the 
nanosecond level because both sets of code were in a state of 
flux at the time. In particular, MASTERFIT was being trans- 
lated from an IBM to a VAX computer, while simultaneously 
incorporating the IAU 1984 resolutions. 

II. Benchmark Observations 

Three fictitious sources and five idealized stations were 
chosen for a set of benchmark observations on five baselines 
at hourly intervals over a 24-hour period: 1 April 1984 0 hr to 


23 hr UT. The J2000 source coordinates are given in Table 1. 
They were chosen to span a wide range of right ascensions and 
declinations. The time of year provides a high probability of 
observing sources near the Sun, and thus magnifies discrepan- 
cies in gravitational bending models. 

Station cartesian coordinates, antenna types, and axis off- 
sets are listed in Table 2. Two of the stations (Haystack and 
Sweden) are routinely employed in the IRIS/ POLARIS experi- 
ments (Ref. 10) while another two (Goldmars and Canberra) 
correspond to the approximate positions of the Deep Space 
Network American and Australian stations, and the last 
station (Pole) is entirely fictitious. The antenna characteristics 
were arbitrarily chosen to include a variety of types and large 
axis offsets to expose and magnify discrepancies in these 
aspects of modeling. 

Table 3 shows the five baselines employed for hourly alter- 
nating observations of the sources of Table 1 . Their lengths 
range from 4000 to 12,000 km: the Canberra-Sweden baseline 
is nearly equal to an Earth diameter. 

Table 4 gives the observing schedule for each of the five 
baselines, making a total of 120 benchmark observations. It 
should be noted that approximately half of these observations 
force one or both stations to observe at negative elevation 
angles. Since the tropospheric delay model is turned off in 
both programs, and both assume a transparent Earth, this pre- 
sents no problem. Magnitudes of the calculated delays range 
between 0.6 and 38.8 ms for these 120 observations. 


III. Comparison of Model Delays 

We first enumerate the known discrepancies in CALC and 
MASTERFIT models, in order to be able to present more 
systematic comparisons. These are as follows: 

(1) The Solar System ephemerides are different: CALC 
uses a version of the MIT PEP ephemeris rotated to 
J2000, while MASTERFIT uses the JPL ephemeris 
DE 200 (Ref. 11). Major effects of these differences 
are expected to be manifested in the solid Earth tide 
and gravitational bending contributions to the delay. 
Differences in the magnitudes of Earth-Sun vectors are 
of the order of 800 m, for example. 

(2) The treatment of the general relativistic bending of 
the ray path is totally different. In addition, MASTER- 
FIT includes the Earth and all planets, while CALC 
only takes account of the Sun, The bending effect of 
the Earth is as large as 155 ps for the benchmark obser- 
vations, while other planets contribute a maximum of 
0.3 ps. 
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(3) CALC corrects the source position employed in model- 
ing antenna offset contributions for tropospheric 
bending with a simplified (tangent of the elevation 
angle) function. This correction uses nominal zenith 
troposphere values, and is present even when the 
tropospheric delay modeling is turned off. The stan- 
dard MASTERFIT model ignores this, since it amounts 
to only a few mm at a 6-deg elevation for a 10-m offset. 


A. Input Model Parameters 

Care was taken to ensure that all parameters entering the 
two models were identical. In addition to the source and sta- 
tion parameters of Tables 1 and 2, these include the following: 


Velocity of light = 

Relativistic gamma factor = 

Earth equatorial radius = 

Flattening factor = 

Solid Earth tide Love numbers = 
Zenith tropospheric delay 


299792458 m/s 
1.0 

6378.14 km 
298.257 
0.609,0.0852 
0 (all stations) 


CALC-MASTERFIT difference does not appear to be corre- 
lated with baseline length, with the worst agreement (92 ps = 
28 mm RMS) occurring for one of the shortest baselines 
(Goldstone to the North Pole). 


In view of the above mentioned known model differences, 
we tried to isolate the major factor responsible for the 2-cm 
delay discrepancies. Three further comparisons were made, in 
which the effects of differences in tidal, relativistic bending, 
and antenna offset models were eliminated in turn. For tides, 
the MASTERFIT contributions were subtracted from the 
MASTERFIT model delays and the CALC contributions 
added; for bending, all contributions except that of the Sun 
were subtracted from MASTERFIT; for antenna offsets, the 
axis offsets of Table 2 were set to zero in both programs. A 
further comparison included all three modifications simultane- 
ously. The results are tabulated in Table 7 (“all” and “+ only” 
indicate all 120 observations, and only those with positive 
elevation angles at both stations, respectively). It is clear that 
discrepancies in tidal and bending models make little if any 
contribution to the raw differences. 


Both CALC and MASTERFIT obtain pole position and 
universal time values for each observation by interpolating 
input tables. Since the interpolating functions are different 
(cubic and linear, respectively), we made sure that identical 
values were obtained by preparing idealized linear input 
tables in both cases. Table 5 shows the values of polar motion 
and UT1-UTC employed for the benchmark calculations. 
Differences in the interpolation algorithms are expected to 
contribute no more than a few mm to theoretical delay differ- 
ences in unfavorable cases. 

For the sake of completeness, Table 6 gives the parameters 
(amplitudes and phases) in the 11 -component ocean loading 
model used in the benchmark calculations. Only the Haystack 
and Goldmars stations are assigned ocean loading displace- 
ments, and these are solely radial, since CALC 6.0 does not 
treat the longitudinal components. The absence of horizontal 
ocean loading displacements is expected to contribute only a 
few mm to calculated delays. 

B. Comparison of Calculated Delays 

Details of the observation-by-observation calculated delays 
are relegated to the figure in the Appendix. Note that the 
delays for one observation (No. 85) differ by approximately 
130 ns. This is due to the above mentioned CALC correction 
of source position for tropospheric refraction, which is unrea- 
sonably large for the North Pole station, whose elevation angle 
is -0.012 deg. This observation has been excluded from all 
RMS quantities quoted below. We note that the overall dis- 
crepancy (excluding negative elevations) is 67 ps (20 mm). The 


The identical treatment of antenna offsets, on the other 
hand, is seen to reduce the RMS difference to 40% of its raw 
value, and the maximum difference by nearly a factor of 5. It 
must be stressed that the benchmark comparison is a stringent 
test, involving a majority of observations at elevations and 
antenna offsets which would never be encountered in real 
data. In view of this, the 26 ps RMS and 50 ps maximum dis- 
crepancies (approximately 8 and 15 mm) are gratifyingly small. 

Further numerical quantification of CALC-MASTERFIT 
differences was performed in three areas: tidal, gravitational 
bending, and tropospheric contributions. Table 8 presents a 
comparison of delay contributions and station (baseline) dis- 
placements due to the various tidal components, for all 120 
observations. In contrast to Table 7, which exhibits only the 
total model delays, Table 8 is concerned with component parts 
of the delays. It is seen that only the solid Earth tide differ- 
ences are substantial, while there is nearly perfect agreement 
for the K\ correction (Ref. 12), pole tide, and ocean loading. 
At present it is not clear whether the solid tide differences are 
due to ephemeris differences or to computational algorithms. 

For relativistic bending, the understanding and reconcilia- 
tion of the two models will require more work than we were 
prepared to perform in this study. We attempted, however, to 
isolate the components of the delay that depend solely on the 
Parametrized Post -Newtonian (PPN) parameter gamma, namely 
the relativistic bending. When this is done, comparison shows 
that the RMS relativistic delay difference is 92 ps (3 cm), 
with a maximum of 254 ps (8 cm). Contrast this with the 
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corresponding numbers for agreement of total delay: 21 ps 
(6 mm) and 49 ps (15 mm). 

While tropospheric delay is outside the scope of this com- 
parison, and is not included in any of the comparisons dis- 
cussed above, we took the opportunity to compare this 
aspect of modeling as well. Both CALC and MASTERFIT 
were set to employ the model of Chao (Ref. 13), which is 
now known to be inadequate for VLBI purposes. The RMS 
CALC-MASTERFIT tropospheric delay difference for the 
benchmark set was 28 ps, with a maximum of 106 ps (8 and 
32 mm, respectively). Only observations at positive eleva- 
tion angles were included. These results are surprisingly 
large for a formula which is algebraically simple; at present, no 
explanation is evident. Naturally a large contribution to the 
discrepancy is made by the substantial fraction of benchmark 
observations that involve very low elevation angles. We hope 
to perform a more thorough comparison of the new Lanyi 


(Ref. 14) and CFA (Ref. 15) tropospheric mapping functions 
in the near future. 

IV. Conclusions 

Comparison of GSFC and JPL VLBI software shows 
agreement at the 1-2 cm level. Included are all components of 
the model in common use at the beginning of 1985, with the 
exception of ionospheric and tropospheric delays. Three areas 
of remaining discrepancy are the use of different Solar System 
ephemerides, different methods of estimating gravitational 
bending, and different corrections for tropospheric refraction 
in calculating antenna offset effects. Millimeter-size discrepan- 
cies could also potentially arise due to the difference in inter- 
polating algorithms for UT1 and polar motion a priori values. 
It is hoped to reconcile these differences during the coming 
year, and to perform similar comparisons of the partial deriva- 
tive and parameter estimation sections of the respective codes. 
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Table 1. Benchmark source positions 


Source RA,hms 


Dec, dms 


T1 

0 

2 

33.76405 

0 

16 

42.2454 

T2 

6 

3 

12.33782 

29 

59 

52.9881 

T3 

12 

2 

33.12210 

59 

43 

17.7545 


Table 2. Benchmark station coordinates, antenna types and offsets 


Station 

x, km 

y , km 

z, km 

Type 

Offset, m 

HAYSTACK 

1492.407 

-4457.267 

4296.882 

EQU 

10 

GOLDMARS 

-2353.620 

-4641.343 

3677.053 

X-Y 

20 

CANBERRA 

-4446.247 

2684.627 

-3691.949 

X-Y 

40 

SWEDEN 

3370.968 

711.466 

5349.664 

AZEL 

2.15 

POLE 

-3796.424 

-104.306 

6360.000 

AZEL 

50 


Table 3. Benchmark baselines and lengths 


Baseline 

Length, km 

HAY-GOL 

3900 

GOL-CAN 

10599 

GOL-SWE 

8014 

GOL-POL 

5465 

CAN-SWE 

12114 


106 



Table 4. Benchmark observations 


Time 


Source 

Time 

Source 

82/4/1 

0 

T1 

82/4/1 12 

T1 


1 

T2 

13 

T2 


2 

T3 

14 

T3 


3 

T1 

15 

T1 


4 

T2 

16 

T2 


5 

T3 

17 

T3 


6 

T1 

18 

T1 


7 

T2 

19 

T2 


8 

T3 

20 

T3 


9 

T1 

21 

T1 


10 

T2 

22 

T2 


11 

T3 

23 

T3 


Table 5. 

Polar motion and UT1 values for benchmark 

Julian 

Date 

Polar Motion, mas 

UT1-UTC, msec 

X 

y 

2445054 

78.0 

436.0 

-170.0 

2445059 

90.0 

432.0 

-182.5 ; 

2445064 

102.0 

428.0 

-195.0 ; 

2445069 

114.0 

424.0 

-207.5 " 


Table 6. Ocean loading model for benchmark 


Component 

Station 

Amplitude, 

cm 

Phase, 

deg 

Station 

Amplitude, 

cm 

Phase, 

deg 

M2 

HAYST 

0.96 

183.2 

GOLDM 

0.23 

351.5 

S2 


0.26 

205.2 


0.14 

250.3 

N2 


0.21 

165.2 


0.12 

305.7 

K2 


0.07 

198.4 


0.05 

276.9 

K1 


0.39 

354.6 


0.99 

43.8 

01 


0.26 

355.2 


0.62 

28.9 

PI 


0.12 

356.8 


0.31 

43.1 

Q1 


0.05 

358.3 


0.12 

20.0 

MF 


0.04 

10.5 


0.01 

295.6 

MM 


0.02 

59.2 


0.01 

104.9 

SSA 


0.04 

264.0 


0.06 

74.2 
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Table 7. Total model delay differences between CALC and MASTERFIT 


Type of Comparison 

RMS, 

ps 

Maximum, ps 


All 

+ Only 

All 

+ Only 

Raw 

73.2 

67.4 

374.1 

237.8 

Identical tides, (j) 

81.8 

64.7 

374.4 

238.7 

Solar bending only, ( b ) 

75.6 

67.0 

357.8 

244.5 

Zero antenna offsets, (c) 

21.2 

26.4 

48.7 

48.7 

GO + (b) + (c) 

38.8 

25.5 

157.0 

50.2 


Table 8. Tidal delay and displacement differences between CALC and MASTERFIT 


RMS difference, ps 


Maximum difference, ps 


Quantity Displacement 

Delay Displacement Delay ~ ' “ 

Local E-Cent. 


Solid tides 

7.6 

6.9 

25.2 

22.1 

17.2 

K 1 correction 

... 

0.12 



0.18 

Pole tide 

0.05 

0.05 

0.10 

0.13 

0.10 

Ocean loading 

0.001 

0.001 

0.004 

0.001 

0.001 



Appendix 


Figure A-l is a tabulation of “raw” model delays calculated with CALC 6.0 and 
MFIT.EXE; 333 and their differences. Listed are the observation number, baseline, 
source, time (ymdh), CALC and MASTERFIT total delays, and their difference (CALC 
minus MASTERFIT). An asterisk (*) following the source name indicates an observation 
for which one or both elevation angles are zero or negative. For each baseline, the root 
mean square difference between CALC and MASTERFIT is calculated for all observations 
as well as for only those at positive elevation angles. 








Model 

delay (psec ) 




Observation 


CALC 6. 0 

MFIT 


DIF. 

1 

HAY-GOL 

Tl* 

82/4/1 

0 

-12585612701. 157 

-12585612711. 

389 

10. 232 

2 

HAY-GOL 

T2 

82/4/1 

1 

-3893892543. 696 

-3893892530. 

870 

-12. 827 j 

3 

HAY-GOL 

T3 

82/4/1 

2 

6627974849. 523 

6627974868. 

641 

-19. 118 

4 

HAY-GOL 

Tl* 

82/4/1 

3 

-7085396676. 466 

-7085396673. 

550 

-2. 916 

5 

HAY-GOL 

T2 

82/4/1 

4 

-9509538985. 199 

-9509538967. 

877 

-17. 322 

6 

HAY-GOL 

T3 

82/4/1 

5 

2175372246. 348 

2175372227. 

878 

18. 471 

7 

HAY-GOL 

Tl* 

82/4/1 

6 

2590632122. 327 

2590632144. 

998 

-22. 672 

8 

HAY-GOL 

T2* 

82/4/1 

7 

-8916992949. 671 

-8916992987. 

427 

37. 756 

9 

HAY-GOL 

T3 

82/4/1 

8 

-2505749430. 424 

-2505749424. 

881 

-5. 544 

10 

HAY-GOL 

Tl* 

82/4/1 

9 

10744906794. 568 

10744906779. 

750 

14. 818 

11 

HAY-GOL 

T2* 

82/4/1 

10 

-2465150182. 063 

-2465150183. 

234 

1. 171 

12 

HAY-GOL 

T3 

82/4/1 

11 

-4659003876. 422 

-4659003817. 

997 

-58. 425 

13 

HAY-GOL 

Tl* 

82/4/1 

12 

12575954242. 330 

12575954240. 

on 

2. 319 

14 

HAY-GOL 

T2* 

82/4/1 

13 

6046931392. 195 

6046931385. 

644 

6. 551 

15 

HAY-GOL 

T3 

82/4/1 

14 

-3016481033. 448 

-3016480965. 

839 

-67. 608 

16 

HAY-GOL 

Tl 

82/4/1 

15 

7005622254. 772 

7005622271. 

324 

-16. 552 

17 

HAY-GOL 

T2* 

82/4/1 

16 

11607049844. 123 

11607049889. 

674 

-45.' 551 

18 

HAY-GOL 

T3 

82/4/1 

17 

1454657529. 508 

1454657622. 

209 

-92. 700 

19 

HAY-GOL 

Tl 

82/4/1 

18 

-2686119354. 696 

-2686119383. 

565 

28. 869 

20 

HAY-GOL 

T2 

82/4/1 

19 

10941265333. 850 

10941265312. 

359 

21. 491 

21 

HAY-GOL 

T3 

82/4/1 

20 

6121656289. 089 

6121656434. 

588 

-145. 499 

22 

HAY-GOL 

Tl 

82/4/1 

21 

-10792502104. 886 

-10792502137. 

607 

32. 721 

23 

HAY-GOL 

T2 

82/4/1 

22 

4441622393. 791 

4441622351. 

781 

42. 010 

24 

HAY-GOL 

T3 

82/4/1 

23 

8236427202. 930 

8236427232. 

913 

-29. 983 






RMS (no *j 

all) 54. 

316 

45. 023 






Model delay (psec) 




Observation 


CALC 6. 0 

MFIT 


DIF. 

25 

GOL-C 

Tl 

82/4/1 

0 

-10489285192. 723 

-10489285177. 

502 

-15. 221 

26 

GOL-C 

T2* 

82/4/1 

1 

29273449598. 709 

29273449578. 

182 

20. 527 

27 

GOL-C 

T3* 

82/4/1 

2 

31666616616. 733 

31666616598. 

619 

18. 114 

28 

GOL-C 

Tl* 

82/4/1 

3 

-23758218846. 926 

— 237 5821 8B40. 

067 

-6. 859 

29 

GOL-C 

T2 

82/4/1 

4 

14353178847. 841 

14353178834. 

335 

13. 506 

30 

GOL-C 

T3* 

82/4/1 

5 

33839550962. 713 

33839550954. 

473 

8. 240 

31 

GOL-C 

Tl* 

82/4/1 

6 

-22993320249. 619 

-22993320252. 

856 

3. 237 

32 

GOL-C 

T2 

82/4/1 

7 

-1782046094. 129 

-1782046038. 

673 

-55. 456 

33 

GOL-C 

T3* 

82/4/1 

8 

28598744840. 469 

28598744842. 

616 

-2. 147 

34 

GOL-C 

Tl* 

82/4/1 

9 

-8644924563. 615 

-8644924540. 

795 

-22. 820 

35 

GOL-C 

T2* 

82/4/1 

10 

-9631363846. 549 

-9631363822. 

950 

-23. 598 

36 

GOL-C 

T3* 

82/4/1 

11 

19030165408. 978 

19030165470. 

940 

-61. 962 

37 

GOL-C 

Tl* 

82/4/1 

12 

10838168545. 026 

10838168579. 

929 

-34. 903 

38 

GOL-C 

T2* 

82/4/1 

13 

-4572797071. 631 

-4572797084. 

982 

13. 350 

39 

GOL-C 

T3* 

82/4/1 

14 

10768069531. 403 

10768069868. 

862 

-337. 459 

40 

GOL-C 

Tl* 

82/4/1 

15 

23983661117. 362 

23983661126. 

302 

-8. 940 

41 

GOL-C 

T2* 

82/4/1 

16 

10415056242. 877 

10415056224. 

272 

18. 606 : 

42 

GOL-C 

T3* 

82/4/1 

17 

8677378465. 377 

8677378510. 

634 

-45. 257 

43 

GOL-C 

Tl* 

82/4/1 

18 

23051112702. 293 

23051112723. 

516 

-21. 223 

44 

GOL-C 

T2* 

82/4/1 

19 

26506825493. 578 

26506825517. 

828 

-24. 250 

45 

GOL-C 

T3* 

82/4/1 

20 

13989229081. 622 

13989228994. 

326 

87. 296 

46 

GOL-C 

Tl 

82/4/1 

21 

8589695859. 210 

8589695B91 . 

955 

-32. 746 

47 

GOL-C 

T2* 

82/4/1 

22 

34227153040. 586 

34227153078. 

053 

-37. 467 

48 

GOL-C 

T3* 

82/4/1 

23 

23575839561. 394 

23575839553. 

200 

8. 194 






RMS (no * 

all) 33. 

770 

75. 894 


Fig. A-1. “Raw” model delays 


110 








Model delay Cpsec) 





Observation 


CALC 6. 0 

MFIT 


DIF. 

49 

GOL-SWE 

Tl* 

82/4/1 

0 

16185720822. 098 

16185720828. 

309 

-6. 

211 

50 

GOL-SWE 

T2 

82/4/1 

1 

17993984333. 845 

17993984317. 

336 

16. 

509 

51 

GOL-SWE 

T3 

82/4/1 

2 

-6704573201. 099 

-6704573227. 

812 

26. 

714 

52 

GOL-SWE 

Tl* 

82/4/1 

3 

-3122544321. 856 

-3122544319. 

901 

- 1 . 

955 

53 

GOL-SWE 

T2* 

82/4/1 

4 

18237985299. 639 

18237985268. 

271 

31. 

368 

54 

GOL-SWE 

T3 

B2/4/1 

5 

3065860092. 861 

3065860066. 

385 

26. 

476 

55 

GOL-SWE 

Tl* 

82/4/1 

6 

-20602185597. 935 

-20602185597. 

695 

-0. 

240 

56 

GOL-SWE 

T2 

82/4/1 

7 

6100368835. 672 

6100368799. 

121 

36. 

551 

57 

GOL-SWE 

T3 

82/4/1 

8 

8191086555. 686 

8191086515. 

249 

40. 

436 

58 

GOL-SWE 

Tl* 

82/4/1 

9 

-25960663261. 192 

-25960663247. 

461 

-13. 

731 

59 

GOL-SWE 

T2* 

82/4/1 

10 

-11271861472. 590 

-11271861505. 

598 

33. 

008 

60 

GOL-SWE 

T3 

82/4/1 

11 

5653219083. 324 

5653219027. 

937 

55. 

386 

61 

GOL-SWE 

Tl* 

82/4/1 

12 

-16042735574. 646 

-16042735569. 

644 

-5. 

003 

62 

GOL-SWE 

T2* 

82/4/1 

13 

-23649410272. 859 

-23649410314. 

626 

41. 

767 

63 

GOL-SWE 

T3 

82/4/1 

14 

-3053364888. 251 

-3053364924. 

789 

36. 

538 

64 

GOL-SWE 

Tl 

82/4/1 

15 

3311626032. 342 

3311626024. 

955 

7. 

387 

65 

GOL-SWE 

T2* 

82/4/1 

16 

-23743982434. 421 

-23743982452. 

398 

17. 

977 

66 

GOL-SWE 

T3 

82/4/1 

17 

-12801967736. 361 

-12801967783. 

033 

46. 

672 

67 

GOL-SWE 

Tl* 

82/4/1 

18 

20705974196. 957 

20705974220. 

002 

-23. 

045 

68 

GOL-SWE 

T2 

82/4/1 

19 

-11499896861. 510 

— 1 1499B96828. 

546 

-32. 

964 

69 

GOL-SWE 

T3 

82/4/1 

20 

-1785231 1291. 384 

-17852311418. 

687 

127. 

303 

70 

GOL-SWE 

Tl* 

82/4/1 

21 

25897978015. 240 

25897978051. 

196 

-35. 

956 

71 

GOL-SWE 

T2 

82/4/1 

22 

5873154425. 261 

5873154471. 

908 

-46. 

647 

72 

GOL-SWE 

T3 

82/4/1 

23 

-15230584157. 899 

-15230584183. 

491 

25. 

592 






RMS (no *, 

all) 49. 

160 

39. 

601 






Model delay (psec) 





Observation 


CALC 6. 0 

MFIT 


DIF. 

73 

GOL-P 

Tl 

82/4/1 

0 

5340718523. 284 

5340718285. 

470 

237. 814 

74 

GOL-P 

T2 

82/4/1 

1 

10213082801. 243 

10213082739. 

583 

61. 

660 1 

75 

GOL-P 

T3 

82/4/1 

2 

-6011503170. 623 

-6011503231. 

485 

60. 862 

76 

GOL-P 

Tl* 

82/4/1 

3 

-7663353656. 411 

-7663353892. 

195 

235. 

784 

77 

GOL-P 

T2 

82/4/1 

4 

6522352926. 267 

6522352851. 

542 

74. 725 

78 

GOL-P 

T3 

82/4/1 

5 

-591502606. 599 

-591502666. 

631 

60. 032 

79 

GOL-P 

Tl* 

82/4/1 

6 

-16171214562. 317 

-16171214649. 

323 

87. 

006 

80 

GOL-P 

T2 

82/4/1 

7 

-3643744283. 646 

-3643744350. 

026 

66. 380 

81 

GOL-P 

T3 

82/4/1 

8 

621339818. 869 

621339750. 

440 

68. 

430 

82 

GOL-P 

Tl* 

82/4/1 

9 

-15173163478. 887 

-15173163572. 

408 

93. 

521 

83 

GOL-P 

T2* 

82/4/1 

10 

-14299105695. 405 

-14299105764. 

133 

68. 728 

84 

GOL-P 

T3 

82/4/1 

11 

-3087131113. 445 

-3087131192. 

689 

79. 

244 

85 

GOL-P 

Tl* 

82/4/1 

12 

-5256757234. 665 

-5256887060. 

910 

129826. 

244 

86 

GOL-P 

T2* 

82/4/1 

13 

-19169522762. 562 

-19169522843. 

099 

80. 

537 

87 

GOL-P 

T3 

82/4/1 

14 

-9533257528. 390 

-9533257592. 

090 

63. 700 

88 

GOL-P 

Tl 

82/4/1 

15 

7738596413. 005 

7738596312. 

038 

100. 

968 

89 

GOL-P 

T2* 

82/4/1 

16 

-15387123092. 829 

-15387123162. 

407 

69. 

579 

90 

GOL-P 

T3 

82/4/1 

17 

-14921370529. 279 

-14921370612. 

200 

82. 921 

91 

GOL-P 

Tl 

82/4/1 

18 

16161150625. 774 

16161150583. 

615 

42. 

159 

92 

GOL-P 

T2 

82/4/1 

19 

-5179119029. 039 

-5179119053. 

382 

24. 

343 

93 

GOL-P 

T3 

82/4/1 

20 

-16078778204. 958 
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One complex channel of the High-Speed Data Acquisition System (a subsystem used in 
the Goldstone solar system radar j, consisting of two correlator modules and one accumu- 
lator module , is operated by the controller and interface module. Interfaces are provided 
to the VAX UNIBUS for computer control monitor, and test of the controller and 
correlator/ accumulator. The correlator and accumulator modules controlled by this 
module are the key digital signal processing elements of the Goldstone High-Speed Data 
Acquisition System. This fully programmable unit provides for a wide variety of correla- 
tion and filtering functions operating on a three megaword /second dataflow. Dataflow is 
to the VAX by way of the I/O port of a FPS 5210 array processor. 


I. Introduction 

A new digital signal processing and data acquisition system 
is installed in the pedestal room at DSS-14 at Goldstone in 
support of radio astronomy and solar system radar experi- 
ments. Figure 1 is an overall block diagram for this system. 
This article is about the correlator assembly; the complete 
system is described in TDA Progress Report 42-77 (Ref. 1). 

The Controller and Interface board (Cl) ties together four 
major components of the High Speed Data Acquisition Sys- 
tem (HSDAS): the VAX 11/780 computer (by way of the 
UNIBUS), the correlators, the accumulators, and the array 
processor (Ref. 1). Additionally, the controller provides the 
timing and distribution of clock and control signals to the 
two correlators and one accumulator board, and provides 
the interface path to the array processor. Together the four 
modules comprise two data channels (or one complex data 
channel) which make up one Complex System Unit (CSU). 


Control paths are provided from the VAX 11/780 computer 
to the correlators and accumulators (Ref. 2), and data paths 
into the Floating-Point System array processor (FPS 5210) 
(by way of the General Purpose Programmable I/O Processor 
[GPIOP]) are also provided. Each correlator can be pro- 
grammed to compute as many as 256 lags of four-bit cross- 
correlation and autocorrelation data using a single-bit refer- 
ence function and single-bit mask function. Also, each corre- 
lator is usable as a digital finite impulse response (FIR) Filter. 
The Cl is contained on one standard universal wire wrapping 
board type 8136-UG6 manufactured by Augat Inc. and holds 
the 1 50 integrated circuits (Fig. 8) used. 

Figure 2 is a block diagram showing the control and data 
paths to and from the Cl, and therein we see its relation to 
the correlators and accumulators in the system. The major 
control path is from the VAX 11/780 by way of a DR11C 
I/O port. Through this port, one configures and runs the 


113 



correlators and accumulators in the desired modes. A discus- 
sion of the operating modes is in Section II below. An addi- 
tional port from the GPIOP is used to monitor the status of 
the accumulator memories. Through this port GPIOP software 
commands the accumulator memory contents to be trans- 
ferred using direct memory access (DMA) to the array pro- 
cessor memory. Each accumulator is double buffered and has a 
FULL flag and an OVERFLOW flag. The FULL flag is moni- 
tored by the GPIOP and indicates when data is ready to be 
unloaded from the accumulator. The OVERFLOW flag indi- 
cates that the accumulator memory was not unloaded in time 
and has been at least partially overwritten with new data. The 
operation of the DMA and flags is explained in Section IV, 
below. 

II. Computer Control Paths 

The major function of the Cl is to distribute data and sys- 
tem clock signals to the correlators and accumulators and to 
control their operation independently of the computer (see 
Fig. 3, a block diagram for the Cl). A 256 X 12 bit memory is 
included for downloading of test data and filter and mask 
functions into the correlators from the VAX. Control func- 
tions are downloaded from the VAX by way of a DR11C 
I/O port (a UNIBUS compatible interface used with several 
devices in the radar system, Ref. 3). The Polynomial Driven 
Time Base and PN Generator (Ref. 3) provide the time base 
and coding signals for the CI. Figures 4 and 5 illustrate the 
Control and Status Register (CSR) and the internal function 
registers accessible through the DR11C port to the CI. Note 
that one complex channel is serviced by one controller (see 
Figs. 9 and 10). Figure 3 illustrates the lag counters and regis- 
ters and the accumulation counters and registers. 

The Correlator/Accumulator (Cor/Acc) control and status 
register (CSR) (Fig. 4) is a broadcast register which is used to 
communicate individually with all function registers in the 
selected Cor/Acc, and is therefore received and decoded on all 
CI boards. Bits 6 through 8 determine which CI board is 
selected. The word pointer bits 0 through 2 determine which 
function register is selected. Bits 4 and 5 set the automatic 
increment of the word pointer and are used for multiple 
reads or writes from the computer. The CLEAR bit (posi- 
tion 10) is broadcast to all CI boards and is used to initialize 
all internal control functions and flags to a known inactive 
state throughout the system. MASTER RUN (bit 15) is 
broadcast to all CI boards throughout the system and starts 
the Cor/Acc operation at a known 1 second epoch. 

The 256 X 12 CI memory is used to hold correlator test 
data and filter and mask coefficients. Although only 12 bits 
are used, it is organized as if it were two bytes using only 
6 bits each and numbered as if all 16 bits were present. Bits 0 


through 3 of the first byte contain data for correlator A, bit 4 
is the mask, and bit 5 is the code for correlator A. Bits 8 
through 11 of the second byte contain data for correlator B, 
with bit 12 as the mask and bit 13 as the code. The memory 
has two address generators. Each is multiplexed and split so 
that each byte can be independently downloaded into the 
correlator. The addresses are organized so that address 00 
corresponds to the last data downloaded into the correlator. 
The address generators are strobed by the system clock during 
downloading. The computer reads and writes both bytes and is 
not split in addressing. It uses the function register 0 (Fig. 5) 
as a pointer to the buffer memory location to be written. 
Function register 1 is a window into the buffer memory. The 
computer address generator location may be incremented 
automatically while writing to the window permitting a block 
data transfer from the computer. The mask bits allow pro- 
gramming any length of correlation function up to 256 lags. 
The reference bits allow any single bit function up to 256 lags 
to be loaded into the correlator. By using the mask and 
reference bits the correlator can run also as a binary FIR filter. 

The function register 2 controls mode and data download- 
ing for correlator A from the buffer memory. Function regis- 
ter 3 controls correlator B in the same way as A. Each correla- 
tor can run in three separate modes and can accept data from 
two separate sources selected by bit 15. In the LONG CODE 
AUTO mode (bit 14 on), the correlator runs continuously, 
updating the reference input modulo 256. In the SHORT 
CODE mode the correlator runs continuously modulo the 
number set as maximum in function register 4. In both modes 
the data and reference are continuously streaming. In the 
SHORT CODE mode the mask (bit 13) must be loaded for the 
selected length set in register 4. In the FIR FILTER mode the 
reference and mask are downloaded from the buffer prior to 
running, and bits 14 and 13 are not set. In this mode the 
reference is not updated and the correlators run as an FIR 
filter. The ZERO BUFFER ADDRESS bit 12 is used prior to 
downloading reference data or masks into the correlator from 
the buffer memory. The AUTO LOAD FROM CODER bit (3) 
is used for testing and for streaming data into the correlator 
reference directly from the coder between word detects. Each 
of the bits 0 through 2 allows for selectively downloading 
segments of the buffer memory into the correlator without 
altering the contents of an unselected segment. Function 
register 4 defines the maximum lag that will be used by the 
correlator/accumulator pairs. The first byte controls accumula- 
tor A and correlator A. Similarly, the second byte controls 
accumulator B and correlator B. In the LONG CODE AUTO 
mode both bytes would be loaded with FF Hex (i.e., all 256 
lags are used). 

Function registers 5 and 6 specify the number (AO of 
coherent sums computed for each lag in accumulator A and B 
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respectively. Function register 7 enables and clears the accu- 
mulator’s internal address generators and must be set properly 
prior to running. 

III. Data Paths 

Figure 2 best illustrates the data path connections into and 
out of the CL The input multiplexer allows for choosing one 
of two inputs to each correlator. The input word consists of 
four bits of data, one bit for reference, and one bit for exter- 
nal loading of the mask. The number system is offset binary 
(Ref. 2), and the size of each word out of each correlator lag 
is 12 bits. This means that the accumulator can add up to 
65,536 samples of 12-bit wide data, giving a maximum result 
28 bits wide. The GPIOP accepts up to 38 bits in word width. 
Each correlator yields a 256 lag by 6-bit output (4 data bits, 
one reference bit, and one mask bit) which can be easily 
passed to other CSU modules to extend the number of lags. 

IV. GPIOP Array Processor Interface 

This Cl module provides high-speed DMA transfer of data 
from the accumulator memories to the FPS 5210 Array Pro- 
cessor via the GPIOP I/O channel. The burst transfer rate is 
3.0 million samples/sec with no reformatting of data to float- 
ing point in the GPIOP. With reformatting, the burst transfer 
rate is 1.5 million samples/sec. The burst length is dependent 
upon the size of the array processor memory (now 256K 
words deep). 

Figure 6 illustrates the GPIOP Command and Device Con- 
trol words and Data Format words. Bits 17 through 19 select 


which Cl module is accessed and bit 16 selects accumulator A 
or B for DMA read. Bits 13 through 15 are command bits that 
define the following functions: 


NULL 

No request 

REPORT 

Tests response of device status; Ready = 1 or 
Overflow = 1 

SEND 

Sets selected device for DMA transfers 

CLEAR 

Clears Ready and Overflow bits to false 

INIT 

Zeros address register in the Accumulator 

It is important to note that the NULL command must precede 
each of the other commands to prevent spurious transient 


“commands” in the Cl interface. 


V. Summary 

The Cl modules control individual Cl units, providing the 
node which ties the VAX, in its controlling and monitoring 
tasks, to the remainder of the high-speed data acquisition 
system. These modules provide for distribution of A/D con- 
verter input, accumulation control (by way of the GPIOP), 
system clock distribution, and system control. The complete 
HSDAS will consist of 8 CSU modules configured with a 
multiplexer as shown in Fig. 7. Three channels have been 
completed and tested. They were used during the April/May 
Venus inferior conjunction radar experiment at Goldstone. 
That series of measurements confirmed that system opera- 
tion is correct. Completion of the remaining 5 CSU modules 
is in progress. 
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Fig. 4. Correlator/Accumulator control and status register format 
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Fig. 9. Correlator/Accumulator System Module, top view 


Fig. 8. Controller and Interface board 
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Fig. 10. Correlator/Accumulator System Module, open view 
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by Way of the DR11-C I/O Port 
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The High Speed Data Acquisition System for the Goldstone Solar System Radar 
requires a number of interfaces for monitor and control functions for the special purpose 
data acquisition hardware. One common interface design is used . A large number of exter- 
nal control and monitor registers may be addressed and observed with this interface 
design , by using only three address locations on the UNIBUS and a standard DEC sup- 
plied input/output port. A broadcast control and status register is introduced which 
addresses any number of different units and registers. 


I. Introduction 

Digital Equipment Corp. supplies several types of interface 
ports (DR11-C, DR11-WC, and others); each one is designed 
for a limited number of address entries onto the UNIBUS. The 
UNIBUS is a single common path that connects the processor 
and all peripherals. The bus contains 56 lines for address, data 
and control information. In order to access a large number of 
peripheral device registers, a special interface is required for 
each different application. Presented here is a simple computer 
controlled general I/O structure designed for monitor and 
control functions using a DR11-C I/O port (Ref. 1) with an 
external Broadcast Control and Status Register (BCSR) and 
multiple function registers. It is designed to be used with the 
DR11-C but the idea lends itself well to any addressed bus 
with limited I/O capability. The DR11-C uses three address 
locations on the UNIBUS; one for communication with the 
I/O port internal registers, one for transferring data to an 
external register, and one for receiving data from an external 
register. By assigning different values to itself, the internal 
register may be used as a pointer to the external registers 
and allows broadcasting an external BCSR for further coding 
and communications to external function registers. A type of 


indirect addressing is generated so that, with only three 
address locations used on the UNIBUS, any number of exter- 
nal registers may be addressed, read, or written. 

II. Limitations with the DR11-C Interface 

Figure 1 shows the register assignments for the DR11-C 
interface. The DRCSR register has only two control bits 
(CSRO, CSR1) for conditioning what the DROUTBUF and 
DRINBUF registers read from or write to an external device. 
A typical interface could therefore read or write only four 
external registers. This is far too few for many monitor and 
control functions for the High Speed Data Acquisition System 
and most other general applications. The DR11-WC has a 
direct-memory-access controller which allows a large number 
of external memory locations to be read or written but costs 
about six times more than the DR11-C. Also, the DR11-WC 
has more functions than are required for monitor and control 
applications. Since the monitor and control applications for 
the Goldstone Solar System Radar do not require high data 
throughput, the following solution using the DR1 1-C I/O port 
and external controller was adopted. 


125 



III. The General Monitor and Control 
Interface, a Solution to This Problem 

Using the CSRO and CSR1 bits in the DRCSR register as 
pointers that tag what area DROUTBUF and DRINBUF read 
and write enables a large number of external registers to be 
addressed. The following example will illustrate how this can 
be done using an external broadcast control and status register. 
A large number of external devices and registers can be com- 
municated with through one port by using this technique. In 
simple terms this is a form of conditional indirect addressing. 

As a simple example, assume the broadcast register format 
is as shown in Figs. 2 and 3. Both CSRO and CSR1 are zero 
and a write operation is requested. This write is to all broad- 
cast registers in all units. (The subsequent read operation will 
now only come from the unit selected that was written in the 
above write.) If no unit was selected, all l’s will appear on the 
data bus indicating that nothing was activated during read- 
back. Now, in the simple case where CSRO = 1 and CSR1 = 0 
we now read and write only to the registers pointed to by the 
broadcast register pointer and unit selected. Unit selection is 
achieved with a simple decoder shown in Fig. 4. In this example , 
only eight units are possible. This could be extended, but con- 
sideration of bus loading and bus length to other units reduces 
the maximum number to no more than ten. In this example, 
eight switches, pull up resistors, and an 8-to-l multiplexer 
(74LS151) are all that are needed to select a unit. When a 
large number of identical units are being used, each one can 
now be made to look like any other without changing the 
software. Only the switch positions need be changed. With 
this logic, a unit can be unselected by having all switches on. 
This allows for unselecting bad units without removing the 
hardware. The “on” position for each switch generates ground 
to the inputs DO, Dl, . . . , D7 on the 8-to-l multiplexer. To 
decode a module and generate the MODEN TRUE signal, 
only one switch should be turned off per unit. Switch one 
signifies unit 0 and switch position eight signifies unit 7 when 
the data select bits A, B, C on the multiplexer decode DO 
through D7. That is when MODEN is TRUE. Table 1 illus- 
trates the unit decoder operation; XXX in the Address column 
indicates “don’t care” conditions. 

The Broadcast Control and Status Register (BCSR) (see 
Fig. 5) addresses the decoded unit using bits ICSR06, ICSR07, 
and ICSR08. Bits ICSROO, ICSR01, ICSR02, and ICSR03 
comprise the function register pointer. Bits ICSR04 and 


ICSR05 can be used to automatically increment the register 
pointer. The bit ICSR04 set to 1 will increment the function 
register pointer by one each time a function register is written 
to. With ICSR05 set to a 1 every time a function register is 
read, the pointer is incremented. Table 2 illustrates the decod- 
ing for reading and writing the function registers. 

The broadcast register can be read only when MODEN is 
true. The tri-state buffer required on the BCSR is not shown. 
Bits ICSR09 through ICSR15 can be used individually for 
control and monitoring of needed internal tasks that must 
occur simultaneously on a number of units. 

Figure 6 illustrates the buffers required for communica- 
tion into and out of the DR1 1-C board. Additionally, the con- 
trol decoding for reading and writing the registers and incre- 
menting the function register pointer is illustrated. Figure 7 
shows one type of function register that can be used. The 
clocks for reading and writing shown in Fig. 5 could control 
any type of register or control function. Each AM25S18 
has both a register output plus a tri-state output to monitor 
its internal condition. This ensures that the busses used in the 
interface are functional. Only the first two 16 bit register files 
and the last register file are shown in Fig. 7. In Fig. 6,NDRDY* 
provides the clock when decoded in the 74138 for CKFROO, 
CKFR01, . . . , CKFR15. The function DTRAN* provides the 
read signal by way of the 74138 decoder for RDFROO, 
RDFR01, . . . , RDFR15. The function CKCSR loads data into 
the BCSR when CSRO and CSR1 are both zero. The function 
FRDET is true when CSRO is one and CSR1 is zero. The 
function CKPTR* increments the function register pointer 
every time a function register is read or written if the appro- 
priate ICSR04* or ICSR05* bits are set. The signals DI00 
through Dll 5 are data inputs to the function registers. DOOO 
through D015 are function register data outputs. 

IV. Conclusion 

This simple interface is easily constructed and can be 
changed to suit a wide variety of interactive applications using 
the UNIBUS on a VAX computer. FORTRAN callable soft- 
ware drivers have also been developed at JPL to run under the 
VAX/VMS operating system. This type of interface was used 
by three different engineers while developing the Goldstone 
Solar System Radar and reduced three different types of hard- 
ware and software interfaces to only one. 


Reference 
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Table 1. MODEN decoding 




Switch Positions 




Address 

MODEN 

DO 

D1 

D2 

D3 

D4 

D5 

D6 

D7 

A 

B 

c 

Y 

0 

0 

0 

0 

0 

0 

0 

0 

X 

X 
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1 

0 
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0 

0 

0 

0 
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True 
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0 
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0 

0 

1 

0 

0 

1 

0 

1 

True 

0 

0 

0 

0 

0 

0 

1 

0 

0 

1 

1 
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0 

0 

0 

0 

0 

0 

0 

1 

1 

1 

1 

True 

0 
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0 

0 

0 

1 

0 

0 

0 

False 


Notes: 1. All eight positions can be individually decoded true and will not decode on all zeros 
or another switch position not selected. 

2. Dip Switch Position: 0 = switch on, 1 = switch off. 



Table 2. Function register write and read decoding 


ICSR03 ICSR02 ICSR01 ICSROO NDRDY* DTRAN* FRDET Output Function True 
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0 
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1 

1 

1 
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1 

1 

1 

1 
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0 
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1 

0 

1 

0 

1 

0 

1 

0 

1 

0 

1 

0 

1 

0 

1 

0 

1 

0 

1 

0 

1 

0 

1 

0 

1 

0 

1 
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0 

1 

1 

1 

1 

1 

1 

1 

1 
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1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 
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1 

1 
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All Outputs False 
CKFROO 
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CKFR01 
RDFR01 
CKFR02 
RDFR02 
CKFR03 
RDFR03 
CKFR04 
RDFR04 
CKFR05 
RDFR05 
CKFR06 
RDFR06 
CKFR07 
RDFR07 
CKFR08 
RDFR08 
CKFR09 
RDFR09 
CKFR10 
RDFR10 
CKFR11 
RDFR11 
CKFR12 
RDFR12 
CKFR13 
RDFR13 
CKFR14 
RDFR14 
CKFR15 
RDFR15 
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Fig. 1. DR11-C register assignments 
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Fig. 2. Broadcast control and status register with function 
register formats 
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Fig. 3. Control and data flow diagram for register pointing 



Fig. 4. Unit decoding 
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The article describes a participant evaluation of a DSN technical training program. The 
Mark IVA project is an implementation to upgrade the tracking and data acquisition 
systems of the DSN. Approximately six hundred DSN operations and engineering mainte- 
nance personnel were surveyed. The survey obtained a convenience sample including 
trained people within the population in order to learn what training had taken place and 
to what effect. The survey questionnaire used modifications of standard rating scales to 
evaluate over one hundred items in four training dimensions. The scope of the evaluation 
included Mark IVA vendor training , a systems familiarization training seminar, engineer- 
ing training classes , and on-the-job training. Measures of central tendency were made from 
participant rating responses. Chi square tests of statistical significance were performed 
on the data. The evaluation results indicated that the effects of different Mark IVA 
training methods could be measured according to certain ratings of technical training 
effectiveness , and that the Mark IVA technical training has exhibited positive effects on 
the abilities of DSN personnel to operate and maintain new Mark IVA equipment systems. 


I. Introduction 

The DSN Mark IVA Project is a multiyear, multimillion 
dollar implementation effort to upgrade telecommunications 
and data acquisition systems of the DSN (Ref. 1). The actions 
taken to establish training requirements and budgets, organize 
training resources, plan and Supervise training activities, and 
evaluate training results are a Mark IVA project responsibility. 
The scope of Mark IVA project training includes four types of 
training: 1) vendor training, 2) a systems familiarization 

training seminar, 3) engineering training classes, and 4) on-the- 
job training (OJT) experiences. Vendor training is associated 
with generic units of equipment which form basic compo- 
nents of Network systems, such as a minicomputer or a micro- 
processor. Seminar training is oriented primarily to descrip- 
tion and discussion of new and modified Network subsystem 
groups of equipment, -and the engineering classes are focused 


upon individual major assemblies within these subsystem 
equipment groups. OJT training occurs for all Network per- 
sonnel who use elements of Network systems to perform tele- 
communications and data acquisition functions. 

The trainers are customer engineers of equipment manu- 
facturers, JPL system designers of hardware and software 
capabilities, and the JPL development engineers and computer 
programmers who have built or modified the DSN data sys- 
tems. The trainees are field engineers, technicians, and opera- 
tors who work at the DSN Deep Space Communications 
Complexes (DSCCs) located in Goldstone, California; Can- 
berra, Australia; and Madrid, Spain; and at the DSN Network 
Operations Control Center (NOCC) in Pasadena, California. 
The training instruction consists of theoretical concepts 
associated with each major equipment assembly, subsystem, 
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and system, plus a variety of techniques and procedures needed 
for installing, configuring, testing, operating, and maintaining 
Mark IVA hardware and software capabilities. 

The research objective was to complete a participant evalu- 
ation of the effects of Mark IVA project training in rapidly 
changing DSN work environments through a training survey 
designed to identify the outcomes of various Mark IVA 
training experiences. Key terms are defined below. 

Vendor training is any commercially available class or 
learning device employed to communicate structured 
product information or to teach well-defined skills asso- 
ciated with maintenance of generic equipment units. 

Seminar training refers specifically to a five-week DSCC 
Implementation Seminar held at JPL in November 1983 
to inform and familiarize DSN personnel with Mark IVA 
subsystems. 

Cognizant development engineer ( CDE) training refers 
to the theoretical and practical instruction provided on 
Mark IVA equipment assemblies by JPL design and devel- 
opment engineers during or after initial installation and 
testing periods at the DSCC. 

On-the-job training (0/7) is the unregulated learning 
activities that take place through self study programs 
under actual field engineering, test, operation, or mainte- 
nance conditions at the Goldstone, Canberra, and Madrid 
DSCC; at the NOCC; and within other DSN facilities and 
groups. 

System refers to the interacting parts of a functional whole 
consisting of Mark IVA equipment assemblies and computer 
programs grouped according to purpose for deep-space 
telecommunications and data acquisition. 

Operations is configuring and activating DSN equipment 
systems to produce end-to-end data flow from the DSCC 
to the NOCC. 

Maintenance is testing, isolating, and correcting faults in 
equipment systems in order to restore malfunctioning 
hardware or software to operational service. 

Effect refers to a consequence or a result of some action 
or process attributable to Mark IVA training experience; 
e.g., the ability to load and initialize a new computer 
program. 

Evaluation means assessing a Mark IVA training experience 
to determine whether training has been technically accurate, 
clearly presented, and applicable to participant needs. 

The research questions were a) whether the effects of 
different Mark IVA training methods can be measured accord- 
ing to certain ratings of technical training effectiveness; and 


b) whether the Mark IVA training, inclusive of vendor, seminar, 
CDE and OJT training experiences, has affected the abilities of 
DSN personnel to operate and maintain new Mark IVA equip- 
ment systems. The significance of the study is that it has been 
of value in assessing the impact of Mark IVA training in terms 
of decisions about additional expenditure and use of dedicated 
project resources and funds for training purposes. The training 
evaluation was wanted to characterize Mark IVA training 
results for JPL DSN managers who are presently working to 
resolve major issues of Mark IVA operability. A study of 
training effects was useful to uncover discrepancies between 
intended and actual training outcomes so that corrective 
action can be taken to modify training design or delivery 
problems. 

As evaluation research, the chief limitation of the study is 
that the research is retrospective. The participant response 
data are based upon self report and subjective opinion mea- 
sures. In order to employ quasi-experimental pretest or post- 
test measures, or even to make timely trainee performance 
appraisals, formal training evaluation methodology would 
have to have been funded and incorporated as part of the 
original Mark IVA training program design. The original 
training plan made the assumption that the value of Mark 
IVA training would be inherent in achieving levels of accept- 
able system performance by trained people at the DSCC and 
the NOCC. It was because system performance issues had 
arisen that it was appropriate to conduct a formal retrospec- 
tive participant evaluation of Mark IVA training. Results of 
the Mark IVA training evaluation were presented at the 
biennial DSN operations and engineering conference of JPL 
managers held on 20-24 May 1985 in Palm Springs, California, 
where it was reported that the effects of different Mark IVA 
training methods had been measured, and that positive effects 
had been identified for the Mark IVA technical training on 
the abilities of DSN personnel to operate and maintain new 
Mark IVA equipment systems. 


II. Method 

The approach of the study was to evaluate the impact of 
Mark IVA training in the context of the individual participant’s 
perceptions of the training program. A Mark IVA Network 
survey was designed to gather four kinds of data: basic bio- 
graphical information, training evaluation ratings, training 
needs, and general comments about training. The Mark IVA 
training program consisted of four types of training presen- 
tations: vendor schools, seminar sessions, engineering tutorials, 
and OJT training. Data were collected from a sample of 
trained and untrained DSN operations and engineering main- 
tenance personnel. The survey obtained a large quantity of 
individual participant training evaluations, which have been 
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descriptively analyzed, plus information about training experi- 
ences and respondent views, which has been qualitatively 
analyzed. 

A. Network Survey Plan 

There is a population of approximately six hundred opera- 
tions and engineering maintenance personnel in the DSN and 
an estimated one-quarter of this population has received some 
Mark IVA project training in the form of vendor classes, 
seminar sessions, and engineering tutorials. An additional 
number of individuals have watched video tapes of the vendor, 
seminar, and engineering training, and have received on-the-job 
training (OJT) in the use of Mark IVA hardware and software. 
There was no simple way to identify the trained people or to 
obtain a random sample. Accordingly, the population of 
DSN operations and engineering maintenance personnel was 
surveyed to obtain a convenience sample. Individual self 
reports identified which people were trained, what training 
had taken place, and to what effect. The Network survey 
which was developed also provided an opportunity for poorly 
trained or untrained personnel to express training concerns 
and preferences, and for training deficiencies and omissions 
to be detected. 

The Network survey was released throughout the Net- 
work in late February 1985. Questionnaire returns were 
requested by the first week in April 1985. The timing of the 
survey was important relative to Mark IVA project implemen- 
tation progress. The DSN could be viewed as being two-thirds 
implemented in March 1985. Training transfer was well under- 
way in most facilities but not concluded. The training process 
was sensitive to problem solving and corrective action while 
project training resources could still be made available to the 
DSN operations organization. The Network survey was accom- 
panied by an internal delivery return envelope and was bulk 
mailed through the JPL and overseas organizational mail 
system to DSN facility and section managers, who were 
asked to assure that copies of the questionnaire were given 
to all technical persons employed in the target facilities and 
groups. A survey cover letter was signed by the DSN opera- 
tions organization office manager requesting but not requiring 
the cooperation of DSN operations and engineering mainte- 
nance personnel in completing the survey. Questionnaire 
response was anonymous and entirely voluntary, which was 
made clear in the letter and on the survey. 

The Network survey measured participant reaction to 
Mark IVA project training. The respondent was identified 
only by his or her facility, the nature of his or her job, and 
whether he or she had participated in any of the Mark IVA 
training activities. If not, the respondent was invited to respond 
to a series of items about interest in training. If the respondent 


had received training, he or she was asked to evaluate each 
type of training: 1) vendor classes, 2) seminar sessions, 3) engi- 
neering tutorials, and 4) OJT training. Each respondent was 
asked to identify his or her training experiences and to rate 
these experiences on a scale of positive to negative effects 
according to the degree to which the training received was 
technically accurate, clearly presented, and applicable to the 
respondent’s needs. Each dimension contained a different 
array of training items. Many of the training subjects were 
identical. The respondents who had participated in training 
activities were asked on a different scale to agree or disagree 
as to whether Mark IVA training had helped respondents to 
perform Mark IVA related work. Finally, each respondent was 
asked if more training was wanted, and was invited to make 
comments relative to training. 

B. Mode of Inquiry 

The Network survey was conducted using questions that 
employ a standard opinion response rating scale, and a five- 
category, single-column response format with all choice 
points defined was developed for the Mark IVA training 
evaluation questionnaire (Refs. 2, 3). The rationale guiding 
the scale format decision was related to the necessity for 
respondents to assign ratings from among more than one 
hundred items in four separate training dimensions. The 
questionnaire had to minimize ambiguity and reduce the 
effort required by respondents to complete the survey, even 
at the cost of some discriminating power, in order to maximize 
the number of survey questionnaires returned. Five categories 
were felt to be easier to choose from than six categories. 
Single-column responses were felt to be less demanding than 
double-column responses when numerous items were to be 
read, considered, and rated. Defining all choice points instead 
of requiring abstract thought about possible alternatives 
avoided time consuming conceptual dilemmas for respondents. 

The Network survey used ordinal response measures in four 
dimensional groups to obtain scores in five response categories 
which are identical across dimensions. There were 20 to 30 
items for each dimension. The same technical subjects occurred 
in more than one training dimension. The units of analysis 
were the rating responses. Every completed survey from a 
person who had been trained produced rating responses in 
one or more groups of training items. Questionnaire rating 
scores in each response category were accumulated to arrive 
at frequency counts and arithmetic means for individual items, 
and a composite mean of the scores for each group of training 
items. Selected score frequencies of like training items in each 
training dimension were compared, and comparisons provided 
a useful check on the reliability of the measurement proce- 
dure. Since most of the respondents who received training 
supplied ratings in more than one training dimension, no 
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group of training items obtained an independent N for use in 
correlating rating scores of one training dimension with those 
of another dimension, or with training effectiveness scores. 
Although association between training dimension rating 
response scores and opinions about training effectiveness in 
Mark IVA job performance could not be statistically estab- 
lished with correlation coefficients, a relationship was inferred 
using nonparametric techniques. 

Data presentations included tables and figures showing 
measures of central tendency, including the calculation of item 
score frequencies, arithmetic means, frequency curve and 
percentage distributions of response scores. Results of chi 
square tests of statistical significance were computed. The 
chi square test of statistical significance was performed on 
Network survey data, given the first null hypothesis (HO) 
that there is no difference in types of Mark IVA training 
received by DSN technical personnel, and the first alternative 
hypothesis (HI) that there is a difference in types of Mark 
IVA training received by DSN technical personnel; and the 
second null hypothesis (HO) that there is no effect of Mark 
IVA technical training on the ability of DSN personnel to 
perform Mark IVA related work, and the second alternative 
hypothesis (7/1) that there is an effect of Mark IVA technical 
training on the ability of DSN personnel to perform Mark IVA 
related work. Replies to an open-ended (comments) question 
were compiled for content analysis. Examples of respondent 
comment are presented and interpreted in connection with 
Mark IVA project training effectiveness or resource allocation 
issues. 

The Network survey did not measure psychological state- 
change variables (Refs. 4, 5) suggested by the participant 
reaction to stimulus other than training, such as experiences 
of flawed Mark IVA equipment system performance. Variables 
associated primarily with OJT training may have interfered 
with training effectiveness ratings, which are vulnerable to 
mixed stimuli. Some people found it difficult to separate 
their OJT training experiences and their training opinions from 
their problematic experiences of Mark IVA equipment per- 
formance. Unrelated psychological state-change variables may 
have biased the training evaluation and influenced training 
effectiveness opinions, with a possible result that some OJT 
training responses may have reflected change which would 
be difficult to connect with training or to compare with ratings 
and opinions associated with other training dimensions. 
Another source of potential bias in the evaluation research 
is an unknown response-shift effect (Ref. 6) which would 
have to be measured using pretest and post-test research 
designs. Although response-shift bias may have occurred, it 
has not been possible under these retrospective evaluation 
conditions to identify a response-shift effect in the statistical 
analysis of Mark IVA training survey data. 


III. Data Analysis 

Six hundred twenty survey questionnaires and return mail- 
ing envelopes were sent out in lot shipments to managers of 
target facilities and groups during the last week in February 
1985. The survey sample interval lasted six weeks until April 5, 
1985 to allow time for responses from internationals, vaca- 
tioners, and rotating shift workers. It was assumed that there 
are 620 DSN operations and engineering maintenance person- 
nel, that each individual received a survey questionnaire and 
return mailing envelope, and that every person was given 
an equal chance to answer the survey questions. The 221 
survey respondents provided a 35.6% return rate of the survey 
questionnaires distributed. Table 1 and Fig. 1 show training 
survey responses from DSN facilities and groups. The distribu- 
tion of respondents by training received is indicated for each 
DSN facility and group in Table 2 and Fig. 2. 

The actual number of DSN operations and engineering 
maintenance personnel in the population, including JPL 
employees, contractors, and internationals, changed several 
times during the long survey sampling interval. Also, the 
definition of a technical person was not precisely specified in 
the letter accompanying the survey. The technical state was 
interpreted somewhat differently from one facility or group 
to another, and in some instances, the appropriate individuals 
may not have received questionnaires. Other members of the 
population may have had no opportunity to participate. One 
of the managers decided to administer the survey only, to 
technical persons who had attended training classes, possibly 
excluding from the survey individuals who might have seen 
training video tapes, or who might have had OJT training 
experience to rate, or those untrained technical personnel who 
might have been numbered among survey respondents. The 
sampling procedure irregularities mean that the 221 survey 
respondents could not represent true DSN population param- 
eters. The survey obtained a sample of convenience which 
approximates certain population characteristics that may be 
verified by other means. Proportions of survey questionnaire 
returns from different facilities and groups can not be directly 
related to actual numbers of technical personnel employed in 
these DSN facilities and groups, but appear to be representa- 
tive for training evaluation purposes. 

The Deep Space Communications Complex (DSCC) per- 
centages seen in Figs. 1 and 2 are larger than those from all 
other DSN organizations. Mark IVA implementation training 
was focused on the hardware and software capabilities which 
have been designed for tracking stations. Most new Mark IVA 
physical equipment system elements are installed, configured, 
operated, tested, and maintained by the DSCC personnel. The 
three DSCCs have been target facilities of first importance in 
Mark IVA implementation training and to the Mark IVA 
training evaluation although the technical training of other 
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DSN facilities and support groups is certainly of equivalent 
programmatic significance. 

Mark IVA project training evaluation was directed at the 
concentration of Mark IVA training resource investments 
reflecting new hardware and software maintenance and opera- 
tion functions and priorities. The survey did not thoroughly 
evaluate training which may have occurred in connection with 
Mark IVA induced changes in DSN personnel job duties at 
all points in DSN organizations. Key DSN facilities and groups 
were part of the Mark IVA training survey because selective 
Mark IVA project training access and training materials have 
been offered to and utilized by most if not all DSN organiza- 
tions. Seminar and OJT training ratings, for example, were 
received from survey respondents all over the Network. Com- 
posite comments provided by the respondents from each 
facility and group are valuable Network training status 
indicators. 

The Ground Communications Facility (GCF), System 
Cognizant Operations Engineers (SCOE) group, and Per- 
formance Analysis Group (PAG) data presented in Tables 1 
and 2 indicate that these organizations may contain a larger 
proportion of untrained people than of trained people. Net- 
work Operations Control Center (NOCC) facility data indicate 
that almost equal proportions of trained and untrained indi- 
viduals may be present in that facility. While these numbers 
can not be accurately used to make representations about 
population conditions, they may be interpreted to suggest 
limited classroom training access, low utilization of available 
Mark IVA training materials (e.g., seminar video tapes), or a 
range of OJT training experiences which may not have been 
reported adequately. 

The comments of respondents from these organizations 
point toward a pattern of unstructured reactive Mark IVA 
training accomplished through documentation self study 
programs, which is discussed further in this section. By con- 
trast, the data associated with the Complex Maintenance 
Facility (CMF) and Compatability Test Area (CTA-21) 
facilities and with the Cognizant Operations Engineers (COE) 
group indicate that larger proportions of trained personnel 
may exist within these organizations. These personnel have 
participated as students in vendor classes, seminar sessions, 
and engineering tutorials, and their training has included 
hands-on equipment OJT training experiences. (CMF survey 
statistics contain questionnaire returns from only two of the 
three complex maintenance facilities.) 

The Network survey returns produced a convenience sam- 
ple consisting of nearly twice as many trained people (143) 
as untrained people (78) among the survey respondents. The 
data suggest that people who received some Mark IVA training 


are twice as likely to respond to a survey that evaluates Mark 
IVA training than people who have not received Mark IVA 
training. Another interpretation of survey sample proportions 
could be that fewer technical personnel may presently require 
Mark IVA training than have already been trained. This is an 
attractive way to look at the data from an organization man- 
ager’s perspective, but does not account for almost one hun- 
dred comments from trained and untrained survey respond- 
ents that suggest some, or more, or better Mark IVA training. 

Following the presentation and discussion of Mark IVA 
training evaluation results at the May 1985 DSN operations 
and engineering conference of JPL managers, $U5K in TDA 
implementation organization funds were allocated for supple- 
mental microprocessor and minicomputer vendor schools to 
be attended by DSN engineering maintenance personnel. 
Assurances were given that JPL technical division engineering 
resources would also be committed to the DSN operations 
organization in support of additional JPL unique equipment 
technical training which was required and appropriately 
funded through the TDA implementation organization. Con- 
ference minutes record a formal action item assigned to the 
TDA implementation organization to develop and fund an 
ongoing training program that involves the support of the 
Deep Space Communications Complexes by the cognizant 
development engineers in technical divisions. 

The central focus of the Network survey was to obtain 
participants’ assessments of the Mark IVA project training 
which had been accomplished and to learn whether Mark 
IVA training requirements had been met or if additional 
Mark IVA maintenance and operations training in DSN faci- 
lities and groups was needed. Figure 3 is a graph of the types 
of work performed by survey respondents, some of whom are 
working in more than one kind of job (e.g., in both engineer- 
ing and supervision categories, or in both operations and 
analysis categories). Note that “operations” and “maintenance” 
were dominant DSN job categories of the survey respondents. 
This information was collected to assure that training assess- 
ments obtained from the survey sample arose from authentic 
DSN maintenance and operations work experiences. The 
following paragraphs review dimensions of Mark IVA training 
which have been evaluated. 

A. Vendor Training 

DSN training on the Mark IVA generic equipment units was 
purchased almost entirely from the commercial certification 
training course offerings of the manufacturer and equipment 
suppliers. Many product-based companies, such as Control 
Data Corporation (CDC), Intel Corp., and Modular Computer 
Systems (Modcomp), build up professionally staffed training 
facilities to support user maintenance and operations programs 
for the company’s main product lines. During the Mark IVA 
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project, it is estimated that S300K in tuition fees were in- 
vested in commercial training (maintenance) courses on micro- 
processors and minicomputers, clocks, discs, peripherals, 
programming, receivers, synthesizers, tape units, and television 
display systems for DSN engineers and technicians. 

Generic equipment units were procured in lot quantities for 
installing and sparing at a dozen DSN locations, so it was 
necessary to train individuals from several DSN facilities and 
groups. Student transportation and sustenance costs became 
a significant factor in DSN organization training budgets for 
major equipment procurements because international travel 
expenses are involved. DSN organizations preferred to send 
the students to vendor schools rather than bring commercial 
equipment instructors to DSN locations because it was cheaper. 
Vendors usually have superior laboratory facilities and test 
equipment for student hands-on maintenance training practice. 

Table 3 shows the participant evaluations of vendor training 
classes by the respondents who either attended the vendor 
schools or watched commercial course video tapes. Of the 
twenty-four vendor classes, seven classes were rated “good” 
with mean values ranging from 4.40 to 4.00. The most success- 
ful vendor training classes, in descending order of student 
ratings, were high-density magnetic tape unit class, high-den- 
sity disc class, Classic minicomputer central processing unit 
(CPU) and memory class, frequency and timing master clock 
class, IAPX 86, 88, 186 microprocessor class, synthesizer 
class, and microsystems equipment troubleshooting class. 
The survey evaluations of these vendor training classes confirm 
earlier participant feedback received in interviews with indi- 
vidual students returning from vendor schools. 

The seven “good” vendor classes are followed by fourteen 
vendor classes that were rated in the 3.85 to 3.00 range, which 
indicates that these vendor training classes have been eval- 
uated as technically accurate, clearly presented, and applicable 
to respondent needs at the “satisfactory” level. Refer to 
Table 3 for vendor school subjects, levels of participation, 
and positive mean values associated with these successful 
vendor training experiences. The Lark disc class and the 
microbus structures (video tape) class received “poor” ratings, 
and the minicomputer 13.5, 256 Mbyte discs class was eval- 
uated as “terrible.” 

It is interesting to note that the negative participant feed- 
back about the minicomputer discs class caused a top priority 
purchase of two disc classes from the disc manufacturer, 
only one of which appears to have been an unqualified training 
success. Both disc manufacturer classes were presented one 
after the other during a two-week time period at the same 
place to the same student group. The Lark disc class followed 
the high-density disc class, and the Lark disc class participant 


evaluation may have suffered by comparison with high-density 
disc class participant evaluation. If the Lark disc class had been 
the single vendor disc training experience that occurred, it is 
possible that ratings of the Lark disc training would have been 
more favorable. Participant feedback about the Lark disc class 
indicated that JPL obtained some valuable information leading 
to a disc design change, which may have been worth the price 
of the Lark disc training regardless of participant ratings. The 
microbus structure video tapes were a recent purchase and 
more participant feedback about these training materials 
would be desirable. Students described the problems with the 
original minicomputer discs class to be inadequate instruction 
plus a lack of proper equipment and materials at the vendor’s 
facility. Survey evaluations confirmed the original negative 
participant feedback. 

Some characteristics that successful DSN vendor mainte- 
nance training class experiences appear to share are instructor 
expertise in the product line, well-prepared technical docu- 
mentation, suitable laboratory test fixtures, and training 
environments with controlled access to practice equipment 
units. DSCC maintenance engineers have formed the majority 
of the DSN attendees at vendor schools. They were hand- 
picked for commercial course opportunities, and they tend 
to be observant of vendor shortcomings in meeting the condi- 
tions for successful training. There seemed to be less concern 
about vendor aptitude for polished training performances 
than about the extent to which hands-on equipment learning 
experiences are supported by the commercial course design. 
It may be as important for DSCC maintenance engineers to be 
able to learn effectively by themselves within the vendor 
environment as it is for the vendor to provide the appropriate 
level of competent instruction. 

Survey respondents’ comments include descriptions of the 
need for additional microprocessor maintenance vendor train- 
ing, and it seems important to fund a 1985-1986 DSN micro- 
processor training program. Based on participant feedback, 
emphasis and priority have been placed on vendor micropro- 
cessor training for DSCC personnel assigned to antenna and 
RF subsystem maintenance, CMF personnel repairing lowest 
replaceable elements (LREs) with microelectronic components 
and modern test fixtures, CTA-21 personnel maintaining new 
microprocessor based RF and digital equipment groups, and 
COE personnel specializing in microprocessor equipment 
maintenance program support. 

DSCC maintenance engineers have asked for Classic mini- 
computer maintenance training in asynchronous data commu- 
nication controllers which are part of the Classic minicom- 
puter assemblies procured by JPL and for which maintenance 
training has never been provided. Assembly language program- 
ming with the Classic operating system and maintenance 
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troubleshooting with diagnostics applications executive 
software also have been suggested as candidate classes for 
1985-1986 vendor minicomputer training. Operating system 
and diagnostics applications capability were an integral part of 
the JPL DSN Classic minicomputer assembly procurements, 
but vendor training classes were not provided. DSCC, CMF, 
CTA-21, and COE equipment maintenance engineers are key 
candidates for Classic programming schools. 

B. Seminar Training 

The DSCC Implementation Seminar was characterized by 
the Mark IVA implementation manager as the centerpiece of 
Mark IVA project training. This program of subsystem famil- 
iarization training events was created to respond to Mark IVA 
operations and maintenance training needs of engineers, tech- 
nicians, and operators at Goldstone, Canberra, and Madrid 
DSCC, and to the Mark IVA technical information needs of 
seminar participants from local JPL DSN operational facilities 
and support groups. Subsystem training presented by Mark 
IVA designers, development engineers and programmers from 
implementation organizations was video taped at JPL’s von 
Karman auditorium television studio annex as a permanent 
training resource for the DSCC and other DSN facilities. 
Video tape sets were also supplied to the engineering groups 
for archival purposes and for new employee training. 

The seminar had Mark III era precedents as a training 
vehicle. The original Mark IVA project training plan envi- 
sioned a 1983 training seminar that would provide videotaped 
high-level technical introductions to Mark IVA systems. 
Funding allocated on the basis of Mark III cost records was 
possibly an order of magnitude off in accuracy for estimating 
the cost of a Mark IVA seminar involving ten times as many 
hardware and software training issues. Engineering organiza- 
tions absorbed large charges as unestimated seminar training 
expenditures, including the significant cost of engineering 
man-hours invested in seminar technical presentations which 
had not been a Mark IVA line item called training in 1983- 
1984 engineering budgets. 

If the hidden cost of man-hours which were expended by 
the engineering groups plus the travel and sustenance expenses 
billed to DSCC budgets had actually been debited to the 
Mark IVA training account, half a million dollars might not 
have been enough to pay for the DSCC Implementation 
Seminar. The training account and engineering account over- 
runs associated with the training seminar support were a 
seminar training evaluation issue to the extent that the mis- 
calculations reflected a notion that training comes free, that 
using DSN internal resources for technical training represents 
just another one of the intangible costs associated with a major 
implementation. There are no free, or invisible, training 


lunches. Engineering organization budgets have to acknowl- 
edge the requirements for technical training in order to fore- 
cast the internal resource obligations needed to support tech- 
nical training on the same basis as any other DSN implemen- 
tation requirement. 

Training should be assigned a priority that gives the func- 
tion enough visibility to compete for available resources. DSN 
organization managers ought to be able to assess a training 
priority in all of their decisions affecting hardware and soft- 
ware deliverables. Future Mark IVA training account alloca- 
tions should be based on provable estimates. Past expenditures 
traceable in the organization’s records may be taken as guide- 
lines, but technical training cost estimates, like other expen- 
sive organization investments, ought to start with current fig- 
ures and comparisons of training delivery methods, compari- 
sons available in the literature (Refs. 7, 8). 

Over one hundred engineering presenters. Fifty DSCC 
engineers and another fifty to sixty local DSN attendees 
were committed to a seminar program of training events 
held at the von Karman auditorium television studio from 
October 31 through December 2, 1983. Implementation 
organizations chose individual presenters based on their 
technical design expertise or range of developmental responsi- 
bilities. Many designers and development engineers elected to 
offer material in team presentation formats which gave more 
people the opportunity to contribute to a seminar knowledge 
base, to gain organization visibility and recognition through 
television appearances, and to stimulate discussions between 
speakers and the audiences. DSCC managers chose the DSCC 
personnel who traveled to JPL for the Five-week seminar. 
Mark IVA complex implementation coordinators led station 
teams of mature experienced engineers with staying power for 
Five weeks of Mark IVA technical presentations and with the 
ability to ask important, interesting questions for video tape 
training purposes. 

Table 4 contains the evaluations of nineteen seminar train- 
ing events which include the technical presentations and the 
dialogues that occurred among the engineering presenters and 
the seminar participants. In examining the frequency and 
mean values associated with each subsystem training item, 
recall that seminar events which were recorded on unedited 
video tapes were personal human experiences, not glossy 
packaged training products. The seminar was a series of formal 
structured presentations interleaved with question and answer 
exchanges punctuated by video tape breaks, coffee breaks, 
equipment crashes, anecdotes and arguments from the floor. 
It was intended to be like that. Dialogue and discussion were 
training objectives, and the survey statistics should not be 
interpreted to mean that presentations did not achieve the 
intended technical training goal of the seminar. 
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Twelve seminar sessions were rated as technically accurate, 
clearly presented, and applicable to respondent needs at the 
“satisfactory” level. These sessions were considered successful 
seminar training experiences. The highest frequency and mean 
values in seminar events responses were assigned to the local 
area network (LAN) training session.. The LAN training was 
given by an exceptional presenter who brought terminal 
equipment to the seminar and by chance or by design, swept 
the seminar participants into exciting exercises with LAN 
programs. Skilled camera work captured this unusual seminar 
training experience on the video tapes. In addition to high 
task competence, the LAN presenter also exhibited strong 
leader position behavior which may have influenced the sur- 
vey respondent perceptions. That combination of trainer 
qualities may have enhanced LAN seminar training effect- 
iveness (Ref. 9). 

Seven seminar sessions have mean values ranging from 2.95 
to 2.42, meaning that survey respondents did not give full 
marks for technical accuracy, clarity, or fit with respondent 
needs to these seminar training experiences. Baseband assem- 
bly (BBA) seminar training, for example, got off to a poor 
start when presenters appeared to be unwilling to respond to 
BBA questions, which could have had some effect on ratings 
for applicability of training to respondent needs. Although 
the BBA seminar training was an engineering development 
team event, most of the technical material was prepared and 
presented by a Madrid DSCC engineer working at JPL on a 
Mark IVA project implementation assignment. Survey respon- 
dent ratings for clarity may have been affected by differences 
in English language enunciation which are natural for this 
individual and for the two other engineers from the Madrid 
DSCC who presented the precision power monitor (PPM) 
material. The Mark IVA systems presentations were made 
by the DSN system engineers. In contrast with the presenters 
from implementation organizations, the system engineers did 
not invest as much time or effort in preparing for the seminar. 
Network support subsystem (NSS) presentations were given 
as brief instructive talks and a panel discussion by several 
teams of individuals. Limited DSCC audience participation 
during the NSS presentations may point to an effect on the 
ratings for applicability of training to respondent needs. 

The less than satisfactory mean value assigned to the receiver 
subsystem seminar training was a surpise. Considerable effort 
was invested in the receiver subsystem seminar presentations, 
which were led by a person with teaching credentials, one of 
the rare presenters with a background and skills in adult educa- 
tion. Test support subsystem seminar presentations included 
speakers for the maintenance support assembly (MSA) and for 
the telemetry simulation assembly (TSA). By accident, the 
TSA presentation master video tapes were reloaded into the 
television studio video tape decks and overwritten during a 


subsequent seminar event. When the tape problem was dis- 
covered, the TSA presentation was reconvened, but the 
second session fell short in technical information content 
and audience involvement through no fault of the presenters. 
The disservice done to TSA seminar training by the tape 
accident may have affected the survey respondent ratings and 
mean value assigned to test support subsystem. 

One problem with the DSCC Implementation Seminar 
video tapes as a permanent DSN training resource is the tech- 
nical changes which have occurred in Mark IVA subsystems 
since the November 1983 presentations given by the imple- 
mentation organizations. Several survey respondents com- 
mented about large differences between seminar training 
information and prevailing Mark IVA equipment subsystem 
realities. While it is not likely or even desirable that another 
Mark IVA seminar will be organized for training purposes, the 

1983 seminar training presentations can be selectively updated 
with 1985-1986 technical status information. Based on partici- 
pant feedback, some candidates for updated or amended tech- 
nical presentations on changed equipment are the antenna, 
command, monitor and control, network support, telemetry 
(including baseband assembly), and test support subsystems. 
The cognizant development engineers for antenna firmware 
and the monitor and control software have experimented 
with updated seminar format video tape training presenta- 
tions, and have gotten good results with informal videotaping 
sessions held at the Goldstone DSCC. 

C. Cognizant Development Engineer (CDE) Training 

CDE training is a traditional JPL engineering activity asso- 
ciated with first installations of JPL unique hardware assem- 
blies or major software packages. It is customary for a JPL 
designer or implementer to accompany the equipment into 
the field when it makes its first appearance in a DSN facility 
system environment. Development engineers have responsi- 
bility for overseeing the new equipment integration into the 
operational subsystems within which it will be expected to 
function. The training idea is that while the development 
engineers are in the field, they can show the facility engineers 
what to do with the equipment, assuming that it works when 
it arrives and that it has been properly supported with spares 
and documentation. 

Formal CDE training for the Mark IVA equipment was 
negotiated with the engineering organizations in January 

1984 following the DSCC Implementation Seminar. Mark 
IVA CDE training classes took place during the initial Mark 
IVA implementation phase at the Goldstone DSCC, where 
field engineers from ail three DSCCs were gathered to assist 
with the first equipment installations. Selected CDE training 
classes were repeated at overseas DSCCs. Mark IVA capabili- 
ties at other DSN facilities were also supported with training 
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by CDEs, but not with formal classes like those which were 
planned and organized for the DSCC. 

The initial training expectations of DSN facility personnel 
are often thwarted because JPL designers and implemented 
tend to view first installations as another milestone in the 
development cycle rather than as completed equipment deliv- 
eries. Protracted cycles of phased Mark IVA hardware and 
software deliveries meant that the CDE training was replete 
with technical information inconsistencies which added con- 
fusion to learning experiences for DSN maintenance and 
operations personnel. The CDE training process lacks instruc- 
tional rigor. Classes were defined and scheduled according to 
the characteristics of what was being delivered, not by any 
rational application of training design standards to DSN 
instructional needs. Requirements for the CDE training were 
that CDEs would provide, to the best of their individual 
abilities, the technical instruction needed to install, operate, 
and maintain the delivered Mark IVA equipment capability, 
including theory of operations information. 

The goal of the CDE training was to bridge the gap between 
the seminar training and on-the-job training experiences of the 
DSN technical personnel. When the Goldstone DSCC CDE 
training classes began, the decision was made to restrict CDE 
training access to facility engineers and technicians who were 
responsible for installing and maintaining the new equipment. 
Operations personnel were represented in the CDE training 
classes by DSCC operations individuals who were committed 
to the crew training for rotating shift operations. There were 
reasons for the decision to hold down operator participation, 
reasons associated with effective utilization of CDE training 
time during the Goldstone equipment installation phase lasting 
from March to November 1984. 

CDEs were delivering unfinished hardware and incomplete 
software packages. Engineers and technicians had to learn 
everything that they could absorb from the CDEs quickly in 
order to help make the Mark IVA equipment systems operable. 
Operations was considered to be something that engineers 
would learn as they discovered how to make equipment work. 
Also, operations information would change each time the 
equipment capabilities changed. The CDE training classes 
were recorded on video tapes for later viewing by station 
personnel. Station trainers and engineers rather than CDEs 
appeared to be the logical choice for distilling accurate data 
and teaching station operators how to use the new equipment. 
CDE training classes were to address urgent operability issues 
for the engineers and technicians. The operator training was to 
be deferred until a later time in the Mark IVA integration and 
test phase when properly functioning hardware and software 
could be dedicated to operator training use. 


The catch for the Goldstone DSCC and the Canberra DSCC 
was that these complexes had to be committed to spacecraft 
tracking operations before that time arrived. A similiar out- 
come was in store for the Madrid DSCC. All of the DSCC 
operations crews have had to take the equipment as they find 
it. They have had to learn to operate the hard way through the 
OJT training experiences. Although CDE training class video 
tapes are available and have been used by the DSCC operators, 
these tapes require engineering interpretation and do not 
always represent the actual state of the Mark IVA hardware 
and software. DSCC engineers appear to have been too busy to 
give training to DSCC operators. 

Pre-survey participant feedback indicated that operator 
crews were unhappy about exclusion as a group from the CDE 
training experiences. The operators’ attitudes appeared to have 
been negatively influenced by lost opportunities for CDE 
training participation. Aversive approach behaviors toward the 
Mark IVA equipment (Ref. 10) may have been formed among 
DSCC operators at least partly as a consequence of CDE train- 
ing access restrictions which meant that the operator learning 
process had to occur through OJT training augmented by 
seminar or CDE training class video tapes. More operator 
participation in CDE training classes probably should have 
been tolerated despite the danger of sidetracking CDEs from 
engineering operability issues and the risk of technical 
misinformation. 

Table 5 contains the frequency and mean values assigned by 
survey respondents to the CDE training classes. Low frequency 
values for some CDE tutorials may mean that a number of 
trainees have not responded to the survey. Alternatively, class 
sizes were determined by Mark IVA equipment delivery condi- 
tions, restricted participation, and crowded work spaces. Of 
the twenty-five CDE training classes held, the mean values for 
fifteen classes range from 4.40 to 3.00. Most of the fifteen 
tutorials were assessed as technically accurate, clearly pre- 
sented, and applicable to the respondents’ needs. These classes 
were considered successful engineering training experiences at 
the “satisfactory” level. One CDE tutorial was rated as “good.” 
The digital spectrum processor (DSP) software training class 
which achieved the highest CDE training mean score of 4.40 
was eulogized in survey respondents’ comments, where the 
CDE was praised as an “excellent” and “pragmatic” instructor. 

According to survey respondents, ten CDE training classes 
did not fully measure up to the evaluation criteria for success- 
ful Mark IVA project training. One of the ten CDE tutorials 
was rated very close to a Mark IVA training failure attributed 
to the embryonic state of antenna-pointing software prema- 
turely introduced into the field. In contrast to mean values of 
the DSCC Implementation Seminar training, survey respondent 
ratings were lower for LAN, maser, and telemetry CDE train- 


142 



ing experiences, while CDE training scores were higher for 
antenna drive assembly equipment, DSCC monitor and control 
(DMC), frequency and timing, microwave, receivers, transmit- 
ter, MSA and TSA test support equipment, and very long 
baseline interferometry (VLBI) receiver training experiences. 

One interpretation of the increases in mean values was sup- 
ported by participant feedback which suggested that seminar 
training had been an authentic learning experience for the 
CDEs. As cited in Carlsson et al. (Ref. 11, p. 2) individual 
experiential learning has been defined by the Kolb learning 
model in these terms: “Immediate concrete experience is the 
basis for observation and reflection. These observations are 
assimilated . . . then serve as guides in acting to create new 
experiences.” Higher means for CDE training than were 
achieved for seminar training may be related to the efforts of 
the individual CDEs to adapt their Mark IVA technical instruc- 
tion presentations to the perceived needs of real maintenance 
and operations people encountered at the seminar and in the 
field. The Mark IVA CDE learning experience might be con- 
sidered as an encouraging step toward a better communica- 
tions network (Ref. 12) between engineering and operations 
that would enhance Mark IV follow on development work and 
Mark V project designs and training. 

D. On The Job Training 

The OJT training process of learning how to do a job by 
actually performing the work is a time honored way to conduct 
DSN technical training. Survey responses from DSN people 
who have rated Mark IVA OJT training experiences describe 
perceptions of Mark IVA equipment environments and job 
training tools available within these work settings. Technical 
documents are the principal resource that supports learning in 
Mark IVA environments under OJT training conditions. Engi- 
neers, technicians, programmers, operators, analysts, super- 
visors, and support personnel obtain OJT training through 
extensive use of the written word in self study programs 
leading to job or equipment knowledge of a major imple- 
mentation. 

Technical documentation makes it possible to enter the 
hands-on equipment operation and maintenance work places 
with a set of meaningful actions to perform. If an individual 
does what the book says to do and produces results that are 
consistent with the job or equipment performance specified by 
the book, OJT learning processes have been reinforced and the 
books become significant elements of OJT training experiences. 
Successful Mark IVA OJT training means that the technical 
reference documents delivered with the Mark IVA equipment 
systems achieved standards comparable to other technical 
information presentations used for training DSN people. The 
information contained in all Mark IVA document deliverables 


should be technically accurate, clearly presented, and appli- 
cable to respondents’ needs. 

Document deliverables that accompany new hardware and 
software are key source materials used to prepare abridged 
training presentations for different DSN groups and to develop 
equipment procedures for operations and maintenance activity 
in DSN environments. System procedures were rarely available 
in advance of hardware or software deliveries, even with good 
preliminary source materials, because systems-level procedure 
instructions have to be designed to mirror the actual behavior 
of interfaced equipment under program control. DSN techni- 
cal personnel have had to rely on Mark IVA engineering source 
documents for firsthand information, particularly in real-time 
operations, about ways of performing Mark IVA related work. 

Table 6 contains frequency and mean values provided by 
respondents with OJT training experiences. Means range from 
3.33 to 1.66 and many of these values indicated trouble with 
Mark IVA OJT training. Participant feedback described the 
OJT training as a trial and error learning process of trying 
things that may not lead to repeatable results, suggesting that 
Mark IVA documentation insufficiencies may account for 
some of the poor OJT training results. The symbiotic relation- 
ship between Mark IVA technical documentation and OJT 
training may be new to some readers, and to illustrate the 
perceptions of association, typical comments are reproduced 
in these excerpts from Network survey data: 

Documentation is only now starting to catch up to the 
changes that have been implemented in the hardware 
and software for Mark IVA. The first six months of OJT 
training were made difficult because hardware and soft- 
ware were changing on an almost daily basis. Operator 
OCIs could work one day and not the next, and there 
was little or no documentation of what was being 
changed. There are still multiple areas of software and 
hardware with no documentation, and what little is 
available is extremely confusing and difficult to inter- 
pret or understand. 

Training and documentation are so poor that theory of 
operation is a word of mouth learning experience with 
everybody expressing their own theories. 

I needed proper training. Proper means training with 
good procedures that work right. You can’t tell whether 
the procedure is bad or the equipment is bad. Things 
should be standard. So far, nothing is standard. Mark 
IVA needs to be standardized with proven procedures. 

Documentation is poor. There really isn’t anything 
resembling training available. 
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The most beneficial training has been from reading 

SOMs and hands-on experience. 

Of the thirty-three kinds of OJT training experiences 
rated, the OJT training area with the highest mean score of 
3.33 was GCF software training. Eight OJT training areas 
with low frequencies and “poor” to “terrible” mean scores 
were NOCC software training experiences. Twenty-four OJT 
training areas were rated by DSCC, CMF, CTA-21, COE, and 
SCOE respondents. High frequency and mean values of 3.27 
for link monitor console (LMC) software training, 3.13 for 
complex monitor console (CMC) software training, and 3.00 
for frequency and timing (FTS) hardware training represented 
successful OJT training experiences that were assumed to have 
been supported in the DSCC and CTA-21 work environments 
with documented Mark IVA information which was techni- 
cally accurate, clearly presented, and applicable to respondents’ 
needs. Twenty of these OJT training areas have high frequency 
values with somewhat lower means ranging from 2.93 to 2.00, 
raising the question of how successfully the Mark IVA docu- 
mentation associated with each of these OJT training experi- 
ences supported the learning process in DSCC and CTA-21 
work settings. Five OJT training areas (four NOCC software 
package training experiences and the DSCC phase calibrator 
training experience) have means below 2.00 and were consid- 
ered Mark IVA OJT training failures that were assumed to 
be partly attributable to Mark IVA technical document 
deficiencies. 


It would be inappropriate to ignore the unstable problem- 
ridden Mark IVA system performance as a locus for variables 
other than technical documents which may affect OJT training. 
The difficulty is to isolate and quantify these variables, or their 
effects, for Mark IVA training evaluation purposes. Inconsis- 
tencies between Mark IVA equipment performance and most 
of the technical information training presentations appear to 
have influenced Mark IVA training evaluation, particularly in 
the OJT training dimension, where people were learning real- 
time operations by trial and error and the Mark IVA docu- 
mentation became a critical element of Mark IVA OJT train- 
ing experiences. Participant feedback invites speculation about 
possible gamma change effects for DSN trainees who appeared 
to have been experiencing “quantum shift in ways of concep- 
tualizing salient dimensions of reality,” versus alpha or beta 
change effects “occurring along relatively stable dimensions 
of reality” (Ref. 5,pp. 135-138). However, the Network train- 
ing evaluation survey research design does not support distinc- 
tive interpretations of psychological state change effects which 
require controlled experimental research designs. Respondents’ 
ratings and comments offer observational evidence, not proof 
(Ref. 13) that the presence of interfering variables may have 
been producing psychological change related to Mark IVA 


work in DSN environments, at least for the participants who 
have supplied Mark IVA training survey data. 

Low mean values associated with Mark IVA OJT training 
experiences should improve as Mark IVA systems performance 
stabilizes and operability problems are solved. Better Mark 
IVA technical document ought to be delivered to the DSN 
work force as expeditiously as possible. Engineering imple- 
mentation organizations need to consider the OJT learning 
aspects of all Mark IVA engineering source documentation, 
especially the need for a close match between the written 
word and equipment reality. Mark IVA funds and higher 
development priorities should be assigned in order to deliver 
the necessary complement of Mark IVA technical documents 
for support of real-time operations OJT training on Mark 
IVA equipment systems in NOCC and DSCC environments. 

E. Differences 

Table 7 shows clear statistical differences between the 
four types of Mark IVA training which have just been dis- 
cussed. One hundred forty-three survey respondents who 
had received training have supplied the composite rating 
frequencies and means displayed in Table 7 for vendor schools, 
seminar sessions, engineering tutorials, and OJT training 
experiences. Survey data indicate that there is one full rating 
point’s difference between mean values assigned to the vendor 
schools (3.55) and to the OJT training experiences (2.54). Half 
of a rating point separates the vendor schools’ score from 
mean values assigned to the seminar sessions (3.00) and the 
CDE tutorials (3.08). The same difference exists between 
seminar session and CDE tutorial scores and the mean value 
for OJT training experiences. 

According to the stated evaluation criteria of technical 
accuracy, clarity of presentation, and applicability to respon- 
dent need, vendor schools were the most successful Mark IVA 
training venture. CDE tutorials and DSCC Implementation 
Seminar sessions have also met the survey training evaluation 
criteria for successful Mark IVA training. OJT training experi- 
ences, with four exceptions, were not very successful. Training 
method comparison data graphs for seminar session, CDE 
tutorial, and OJT training experience rating scores have been 
prepared on Mark IVA technical subjects which have been 
covered by all three types of training. Frequency curve com- 
parisons of training survey mean values are provided to assist 
DSN implementation organizations who want to look at 
graphic representations of the survey data in connection 
with their particular areas of technical training responsibility. 
Refer to Figs. 4 through 21 for these graphs. 

The training experience could perhaps represent a million 
dollar Mark IVA project investment if Mark IVA implementa- 
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tion organization training man-hours had been calculated and 
charged above the line. Even larger sums could probably be 
allotted to Mark IVA technical drawing and document costs. 
As suggested by the Network survey OJT training results, 
future DSN implementation project training and documen- 
tation efforts could be enhanced by priorities and project 
development resource allocations rigorously maintained from 
design to first installation stages of the implementation project 
for successful results in these key DSN support functions. 

F. Effects 

Survey respondents who had received training were asked 
to rate the effectiveness of Mark IVA training by expressing 
opinions as to whether they agreed or disagreed with the 
statement that Mark IVA training had helped them to perform 
Mark IVA related work in their jobs. One hundred forty-three 
people in the survey were qualified to determine whether their 
job performance abilities were affected by training and to state 
their opinions about Mark IVA training effectiveness. Table 8 
is a breakdown of opinion responses by DSN facility and 
group. Figure 22 displays the same data as a percentage 
distribution of rating totals across the five opinion categories 
of strongly agree, agree, no opinion, disagree, and strongly 
disagree. A glance at Fig. 2 serves as a reminder that the DSCC 
respondents are the largest group of trained people in the 
survey. In Fig. 22, the DSCC led other DSN organizations in 
Mark IVA training effectiveness ratings. 

The percentage distribution in Fig. 22 reveals that 78% of 
the survey respondents who had received training perceived 
Mark IVA training to have affected their abilities to perform 
Mark IVA related work while 22% of survey respondents who 
had received training had no opinion. Equivalent percentages 
(7% and 6%) of respondents strongly agreed and strongly 
disagreed about the effects of Mark IVA training. A larger 
percentage (55%) consisting of people who strongly agreed and 
agreed felt that the training had been helpful. A smaller 
percentage (23%) consisting of people who strongly disagreed 
and disagreed felt that the training had not been helpful. The 
fact that thirty one people expressed no opinions is inter- 
preted to mean that these individuals were ambivalent about 
Mark IVA training effectiveness. They may not be able to 
perceive that training helps, yet they may not be willing to 
assert that training does not help. 

The effects of Mark IVA training as perceived by survey 
respondents are more obvious in Fig. 23, where opinion 
response ratings were combined by DSN facility and group 
into positive and negative effect classifications, separating 
these data from the statistics of survey respondents who had 
no opinion. Positive effect responses consist of all of the 


ratings in the “strongly agree” and “agree” opinion categories. 
Negative effect responses consist of all of the ratings in the 
“strongly disagree” and “disagree” opinion categories. Posi- 
tive effect rating percentages, particularly for the DSCC, are 
greater than negative effect rating percentages, except for the 
percentages reported by NOCC, CTA-21, and PAG respon- 
dents. Survey Findings suggest that NOCC and PAG respon- 
dents had not experienced adequate or satisfactory Mark IVA 
training. 

By contrast, the Mark IVA training which has been made 
available to the CTA-21 facility was equal in most respects to 
the DSCC Mark IVA training because CTA-21 functionally 
resembles a tracking station. Survey findings do not suggest 
a reason why a larger percentage of the ratings reported by 
trained CTA-21 respondents indicates negative training 
effects. Figure 23 percentages derived from one hundred 
twelve decisive opinion response ratings (excluding the “no 
opinion” response ratings) indicate that the Mark IVA training 
has had positive effects for a majority (70%) of the trained 
survey respondents who have expressed decisive opinions. 
A minority (30%) of the trained survey respondents who have 
expressed decisive opinions appear to have felt that the Mark 
IVA training had not been helpful in its effect on their abilities 
to perform Mark IVA related work. 

G. Significance 

The nonparametric chi square test of statistical significance 
for categorical variables and enumerative data was selected to 
determine whether measures of association for variables 
reported in this study can be considered significant. A non- 
parametric choice acknowledges that conventional probability 
assumptions have not been satisfied by the sampling design of 
this research, although the magnitude of x 2 values obtained by 
applying chi square distributions to the survey data clearly 
points toward the operation of nonchance factors at an 
appropriately conservative level of significance. Table 9 pre- 
sents the results of a two variable chi square test of the rela- 
tionship between types of Mark IVA training and training 
survey rating responses, and Table 10 presents the results of a 
single variable goodness of fit test of observed and theoretical 
survey opinion response distribution (Refs. 14, 15). In formal 
statistical terms, the null hypotheses (I/O) have been estab- 
lished that there is no difference in types of Mark IVA training 
received by DSN technical personnel, and there is no effect 
of Mark IVA technical training on the ability of DSN person- 
nel to perform Mark IVA related work (see Section II: Meth- 
od). Alternative hypotheses (H 1) are that there is a difference 
in types of Mark IVA training received by DSN technical 
personnel, and there is an effect of Mark IVA technical train- 
ing on the ability of DSN personnel to perform Mark IVA 
related work. The significance level for both tests is a = 0.01 . 
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The value of x 2 is calculated for the two variable case from 
the formula 


X 


2 




(f 0 -0 2 

4 


where 

f = the observed value 

J o 

f e = the expected value 


£ 


c 

£ 


sum of the ratio over both rows and 
columns 


The value of x 2 is calculated for the one variable case from 
the formula 
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where 

f = the observed value 
f e = the expected value 


£■ 

»= i 


sum of the ratio over k categories 


Sampling distributions are the chi square distributions with 
degrees of freedom (df) equal to (/* - 1) (c - 1) for the two 
variable test. For the one variable test, df = k - 1. The two 
variable test has df = 12, and at a = 0.01, the critical region 
consists of all values of x 2 ^ 26.217. The one variable test 
has df = 4, and at a = 0.01; the critical region consists of all 
values of x 2 ^ 13.277. Table 9 shows the obtained x 2 value 
of 209.817 for the two variable test case to be greater than 
the critical value of 26.217 which is required for significance 
at the 0.01 level. This result means that HO may be rejected 
and HI may be asserted: there is a statistically significant 
difference in types of Mark IVA training received by DSN 
technical personnel. Table 10 shows the obtained x 2 value of 
80.460 for the one variable test case to be greater than the 
critical value of 13.277 which is required for significance at 
the 0.01 level. This result means that HO may be rejected and 
H\ may be asserted: there is a statistically significant effect 
of Mark IVA technical training on the ability of DSN person- 
nel to perform Mark IVA related work. 


H. Training Needs 

The discussion of survey information up to this point has 
been concerned with data from survey respondents who 
received training. The needs of survey respondents who did 
not receive Mark IVA training or who felt that they had been 
poorly trained are important to the Mark IVA training evalua- 
tion and were not as precisely measured as the dimensions and 
effects of accomplished training. Survey respondents who 
received no training make up 35% of the survey sample. They 
have contributed to the evaluation database and provided 
many of the survey comments which indicate where Mark 
IVA training deficiencies and omissions may be found. NOCC 
and PAG survey respondents, for example, have already been 
identified in other parts of the evaluation as the sources of 
information which suggested that these organizations may 
need attention and more resource assistance to accomplish 
Mark IVA training. 

Quantified Mark IVA training needs are displayed in 
Figs. 24 and 25, which note the types of training requested 
by untrained and poorly trained survey respondents and the 
subjects for training that interested these respondents. The 
figures show selection frequencies that occurred in training 
method and subject categories. Those respondents who were 
untrained and poorly trained and who made the choices 
usually selected more than one training method or subject. 
The selection frequencies for the OJT training method and for 
the subjects of JPL unique equipment and software are larger 
than the numbers for any other selection categories. The 
respondents evidently felt that the needs for Mark IVA OJT 
training and for classes in JPL unique hardware and software 
outweighed other needs, which is not surprising for respon- 
dents who may have been working at their jobs without 
training in the Mark IVA environments. Commercial equip- 
ment and software training classes also have high selection 
frequencies in the subject categories. Frequencies associated 
with vendor school, seminar session, and engineering tutorial 
types of training are on a par with one another in the method 
categories. 

Although Mark IVA technical documents have been charac- 
terized earlier in this section as the principal resource for 
Mark IVA OJT training, the survey comments of the untrained 
and poorly trained respondents highlighted experiences of 
being shown what to do and told how to do it as a meaningful 
(if not always comfortable) form of OJT training. The chal- 
lenge for managers interested in cultivating this method of 
training is to identify and assign a sufficient number of trained 
people who know how to instruct others to serve as resources 
for individuals who need productive or timely show-and-tell 
OJT training. It is in every DSN organization’s interest to 
encourage trained people to share Mark IVA knowledge by 
helping coworkers with no Mark IVA background to develop 
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the capability required for getting the job done. Managers 
could stimulate some informal Mark IVA training activity 
by rewarding people who are qualified and willing to teach 
others. The survey comments suggested that there may be a 
number of DSN people who would probably do better work if 
they received some simple show-and-tell training support from 
knowledgeable members of the organization. The alternative 
to rewarding competent in-house instructors is to force people 
to learn the hard way by trial and error, which lowers organi- 
zation productivity and morale. 

Survey comments cited hands-on equipment experience as 
significant Mark IVA OJT training which would be available 
only in facility environments under maintenance or operations 
supervision and special procedural controls. Section and 
facility managers should be aware of individuals who need or 
want hands-on Mark IVA experience and would be in the best 
position to take the appropriate action for providing this 
form of OJT training. In “other” categories noted on Figs. 24 
and 25, the untrained and poorly trained respondents wrote 
twelve training requests: DSCC-NOCC-MCCC data flow, 
computer-aided instruction on NSS software, Mark IVA 
system capabilities, limitations, workarounds, reliable refer- 
ence materials, antenna control, DSN system flow and config- 
uration, qualified instructors, more classroom work, and better 
documentation (three items repeated prior statements). The 
item suggesting NSS software computer-aided instruction may 
be a useful Mark IV follow on software design input. The 
remaining items would be local classroom or OJT training 
options where appropriate resources are available. 

There seem to be pressing local needs for sustained Mark 
IVA training within DSN organizations, at least as represented 
by the comments of the respondents who were untrained and 
poorly trained. Facility and section managers are responsible 
for establishing structured in-house training programs that 
report regularly and utilize formal record keeping practices, 
such as training hours checkoff sheets, lesson plan outlines 
(LPOs), and posted lists of technical documents, library 
books, video tapes, commercial course opportunities, resident 
expert lecture schedules, and the like. Several DSN facilities 
already have individuals who are accountable for training. 
Such attention to the training function may help to assure 
that DSN facility training occurs according to local training 
plans and schedules of training events. 

IV. Conclusions and Recommendations 

The research shows that training method differences can 
be measured through ordinal response ratings of Mark IVA 
training experiences. Mark IVA technical training is effective 
for DSN personnel who operate and maintain new Mark IVA 
equipment systems. Survey data indicate that on balance 


Mark IVA training helps people perform Mark IVA related 
operations and maintenance jobs in Mark IVA work environ- 
ments. Vendor classes have received favorable ratings. Partic- 
ipant feedback for this training dimension indicates good 
return on commercial course investments. Scores for seminar 
training sessions did not produce frequent values at positive 
or negative extremes. The engineering tutorial ratings were 
mixed and on-the-job training experiences produced values in 
the satisfactory-to-poor evaluation range because this dimen- 
sion is where DSN respondents have had difficulty keeping 
their Mark IVA training experiences separated from their 
experiences of flawed Mark IVA equipment performance. 

Rating mean values associated with successful training 
experiences are consistent with, but are not necessarily re- 
lated to, the positive opinion response scores indicating 
agreement that Mark IVA training helps to perform Mark 
IVA work. Rating mean values associated with unsuccessful 
training experiences are consistent with, but are not necessarily 
related to, the negative opinion response scores indicating 
disagreement that Mark IVA training helps to perform Mark 
IVA work. Statistical significance of these data has been tested 
with chi square distributions. Obtained values permit rejection 
of the null hypotheses, asserting the alternative hypotheses 
that there is a difference in types of Mark IVA training, and 
there is an effect of Mark IVA technical training on the ability 
of DSN personnel to perform Mark IVA related work. 

Recommendations resulting from the Mark IVA project 
training evaluation are summarized as follows: supplement- 
ary Mark IVA training resource allocations including more 
commercial courses in minicomputer and microprocessor 
vendor schools; seminar session technical presentation video 
tape updates; engineering review of unsuccessful CDE tutorial 
presentations to help determine whether these tutorials should 
be repeated in the field; higher project priorities and funds for 
technical training and document delivery improvements; and 
operations management review of DSN organization local 
training plans, resources, and schedules in DSN facilities and 
support groups. 

Some future issues in the area of training design and evalua- 
tion were suggested by review of related literature as being 
worthy of DSN research. These issues include simulation 
training applications (Ref. 16); designing new matches between 
training materials and technical documents (Refs. 17, 18); 
isolation of psychological state change variables which affect 
training (Refs. 4, 5); and use of learning models (Refs. 10, 11) 
to characterize future training designs and to build better 
intraproject communication networks (Ref. 12) in anticipa- 
tion of Mark IV follow on development work, and Mark V 
engineering implementation projects. 


147 



Acknowledgment 


Portions of the material presented in this article have been previously submitted to 
and accepted by the University of San Francisco as graduate research. Assistance provided 
during the training evaluation study by Duncan L. Dieterly, Ph.D., psychologist and 
University of San Francisco senior faculty member, is gratefully acknowledged. Manage- 
ment support provided during Mark IVA project training by Jet Propulsion Laboratory 
Deep Space Network organization managers Raymond J. Amorose, Louis E. Butcher, 
Thomas Reid, Robertson Stevens, Jose Urech, Robert J. Wallace, and Paul T. Westmore- 
land is appreciated. Special thanks are extended to Jet Propulsion Laboratory technical 
division managers, supervisors, and Mark IVA cognizant development engineers, without 
whom there would have been little Mark IVA training to evaluate. 


References 


1. Gatz, E. C., “Networks consolidation program system design,” Telecommunications 
Data Acquisition Progress Report 42-63, March-April 1981, Jet Propulsion Labora- 
tory, Pasadena, CA, pp, 150-153. 

2. Johnson, W. L., and Dixon, P. N., “Response alternatives in Likert scaling,” Educa- 
tion and Psychological Measurement, Vol. 44, No. 3, Autumn 1984, pp. 563-567. 

3. Dixon, P. N., Bobo, M., and Stevick, R. A,, “Response differences and preferences 
for all-category-defined and end-defined Likert formats,” Educational and Psycho- 
logical Measurement , Vol. 44, No. 1, Spring 1984, pp. 61-66. 

4. Putnam, A., “Designing from the logic of people,” Training and Development 
Journal, Vol. 35, No. 5, May 1981 , pp. 125-131. 

5. Golembiewski, R. T., Billingsley, K., and Yeager, S., “Measuring change and per- 
sistence in human affairs: types of OD designs,” Journal of Applied Behavioral 
Science, Vol. 12, No. 2, 1976, pp. 132-157. 

6. Bray, J. H., Maxwell, S. E., Howard, G. S., “Methods of analysis with response 
shift bias,” Educational and Psychological Measurement , Vol. 44, No. 4, 1984, 
pp. 56-61. 

7. Holden, S. J., “The science of developing technical training,” Training and Develop- 
ment Journal, Vol. 38, No. 9, September 1984, pp. 35-41. 

8. Zemke, R., “Development and delivery of training: media, methods, and means,” 
Training, Vol. 20, No. 10, October 1983, pp. 47-53. 

9. Justis, R. T., Kedia, B. L., and Stephens, D. B., “The effect of position power and 
perceived task competence on trainer effectiveness: a partial utilization of Fiedler’s 
contingency model of leadership,” Personnel Psychology , Vol. 31, No. 1, Spring 
1978, pp. 83-93. 

10. Mager, R. F., Developing Attitude Toward Learning (Belmont, CA: Fearon Pub- 
lishers, 1968). 



11. Carlsson, B., Keane, P., and Martin, J. B., “R&D organizations as learning systems,” 
Sloan Management Review , Vol. 17, No. 3, Spring 1976, pp. 1-16. 

12. Tushman, M. L., “Managing communication networks in R&D laboratories,” Sloan 
Management Review, Vol. 20, No. 2, Winter 1979, pp. 37-49. 

13. Kirkpatrick, D. L., “Evaluating training: evidence vs proof,” Training and Develop- 
ment Journal, Vol. 31, No. 11, November 1977, pp. 9-12. 

14. Runyon, Richard P., and Haber, Audrey, Fundamentals of Behavioral Statistics 
(Reading, Massachusetts: Addison-Wesley Publishing Co., 1984), pp. 362-370, 
p. 418. 

15. Babbie, Earl, Practice of Social Research (Belmont, California: Wadsworth Publish- 
ing Co., 1983), pp. 424-426, 498-499. 

16. Simon, C. W., and Roscoe, S. N., “Application of a multifactor approach to training 
research,” Human Factors, Vol. 26, No. 5, October 1984, pp. 591-612. 

17. Klema, C., Casey, H. B., and Caple, D., “Technical and training manuals can be one 
and the same,” Training and Development Journal , Vol. 38, No. 1, January 1984, 
pp. 74-75. 

18. Jons, J. A. R., “Standard procedures: a quick path to technical training,” Training/ 
HRD, Vol. 19, No. 8, August 1982, pp. 52-55. 



Table 1. Survey sample 


Facility/Group 

Number 

Percent 

DSCC 

102 

46.2 

CMF 

16 

7.2 

NOCC 

28 

12.7 

GCF 

16 

7.2 

CTA-21 

14 

6.3 

COE 

15 

6.8 

SCOE 

19 

8.6 

PAG 

11 

5.0 

Total 

221 

100.0 


Table 2. Respondents of training survey 


Facility/Group 

Trained 

Untrained 

Number 

Percent 

Number 

Percent 

DSCC 

78 

35.4 

24 

10.8 

CMF 

12 

5.4 

4 

1.8 

NOCC 

15 

6.8 

13 

5.9 

GCF 

5 

2.2 

11 

5.0 

CTA-21 

9 

4.0 

5 

2.3 

COE 

13 

5.9 

2 

0.9 

SCOE 

7 

3.2 

12 

5.4 

PAG 

4 

1.8 

7 

3.2 

Total 

143 

64.7 

78 

35.3 
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Table 3. Vendor training: frequency and mean values of respondents’ ratings 1 


Vendor Classes/Video Tapes 

Frequency if) 

Mean (X) 

High-Density Disc 

11 

4.36 

Lark Disc 

11 

2.81 

Surveillance TV 

8 

3.75 

IAPX 86, 88, 186 Microprocessors 

13 

4.00 

IRMS 88, 80 Microprocessor Operating System 

4 

3.50 

IRMX 86 Microprocessor Operating System 

7 

3.71 

Introduction to Microprocessors 

7 

3.57 

MCS 80/85 Microprocessors 

11 

3.45 

Microbus Structures 

4 

2.75 

PL/M Programming 

9 

3.66 

RMX Programming 

1 

3.00 

Synthesizers 

8 

4.00 

Microsystems Equipment/Troubleshooting 

7 

4.00 

Gassic Minicomputer CPU and Memory 

14 

4.21 

Classic Minicomputer Extended Arithmetic Unit 

13 

3.76 

Gassic Minicomputer Disc Controller 

9 

3.44 

Gassic Minicomputer Bus I/O Processor 

14 

3.85 

Minicomputer Diagnostics Applications Executive 

4 

3.25 

Minicomputer Introduction ta Microprocessors 

10 

3.10 

Minicomputer 13.5, 256 Mb Discs 

8 

1.50 

Receivers 

4 

3.50 

Console Displays 

13 

3.53 

High-Density Magnetic Tape Units 

5 

4.40 

FTS Master Clock 

7 

4.14 

Excellent = 5.00 

Good = 4.00 

Satisfactory = 3,00 

Poor = 2.00 

Terrible = 1.00 



Table 4. Seminar training: frequency and mean values of respondents’ ratings' 


Seminar Sessions/Video Tapes 

Frequency (f) 

Mean (X) 

Antenna Subsystem 

44 

3.04 

Baseband Assembly 

25 

2.92 

Block IIA, V Masers 

14 

3.28 

Command Subsystem 

25 

3.00 

DSCC Monitor and Control Subsystem 

49 

3.10 

Digital Spectrum Processing Subsystem 

19 

3.05 

Frequency and Timing Subsystem 

30 

3.13 

Ground Communications Facility Subsystem 

29 

3.03 

Local Area Network 

56 

3.35 

Mark IVA Systems 

35 

2.82 

Microwave Subsystem 

15 

3.13 

Network Support Subsystem 

23 

2.82 

Precision Power Monitor 

28 

2.89 

Receiver Subsystem 

36 

2.80 

Telemetry Subsystem 

28 

3.00 

Test Support Subsystem 

21 

2.42 

Tracking Subsystem 

22 

2.95 

Transmitter Subsystem 

22 

3.27 

VLBI Receiver 

25 

3.00 


‘Excellent 

= 5.00 

Good 

= 4.00 

Satisfactory 

= 3.00 

Poor 

= 2.00 

Terrible 

= 1.00 



Table 5. CDE training: frequency and mean values of respondents’ ratings 1 


CDE Tutorials/Video Tapes 

Frequency if) 

Mean ( X) 

Antenna Drive Assembly 

13 

3.23 

Antenna Pointing Software 

15 

2.06 

Area Routing Assembly Software 

9 

2.77 

BLK III RCVR/EXC/Controllers 

23 

3.13 

BLK IV RCVR/EXC/Controllers 

24 

3.04 

Command Modulator Assembly/Switch 

18 

2.83 

CPA Software 

8 

2.87 

Common Computational Modules 

5 

3.00 

Data Channel Filter 

4 

2.50 

DMC Software 

13 

3.53 

DSP Software 

5 

4.40 

Frequency and Timing 

16 

3.43 

GCF Software 

4 

3.50 

Local Area Network 

29 

3.13 

Maintenance Support Assembly 

20 

2.85 

Masers/S-Band FET/LNA 

7 

2.57 

Microwave/Controller 

14 

3.71 

MDA Software 

6 

2.66 

NSS Software 

3 

3.00 

Phase Calibrator 

8 

2.75 

Portable Development System 

8 

3.12 

Telemetry Simulation Assembly 

15 

3.26 

TPA Software 

7 

2.71 

Transmitter/Controller 

13 

3.61 

VLBI Receiver/Controller 

13 

3.38 

Excellent = 5.00 

Good = 4.00 

Satisfactory = 3.00 

Poor = 2.00 

Terrible = 1.00 



Table 6. OJT training: frequency and mean values of respondents’ ratings 1 


Hardware and Software OJT 

Frequency (f) 

Mean (X) 

Antenna Control Subassembly (ACS) 

29 

2.89 

Antenna Drive Assembly (ADA) 

29 

2.93 

Antenna Pointing Assembly (APA) 

25 

2.72 

Area Routing Assembly (ARA) 

26 

2.73 

Baseband Assembly (BBA) 

11 

2.00 

Block III and Block IV Receivers 

31 

2.90 

Command Modulator Assembly (CMA) 

26 

2.76 

Complex Monitor Console (CMC) 

29 

3.13 

CPA Software 

21 

2.57 

DDP Software 

9 

2.11 

Digital Spectrum Processing (DSP) 

9 

2.77 

Frequency and Timing (FTS) 

25 

3.00 

GCF Software 

9 

3.33 

Local Area Network (LAN) 

30 

2.86 

Link Monitor Console (LMC) 

33 

3.27 

Maintenance Support Assembly (MSA) 

16 

2.18 

Masers 

15 

2.66 

Microwave 

21 

2.76 

MDA Software 

21 

2.71 

NCD Software 

6 

1.66 

NMC Software 

7 

2.14 

NRS Software 

7 

1.85 

NSS Software 

10 

2.10 

NTK Software 

9 

2.11 

NTM Software 

7 

1.85 

Phase Calibrator 

9 

1.66 

Precision Power Monitor (PPM) 

22 

2.72 

Portable Development System (PDS) 

11 

2.27 

Telemetry Simulation Assembly (TSA) 

25 

2.84 

TPA Software 

23 

2.91 

Transmitters 

21 

2.80 

VAP Software 

7 

1.85 

VLBI Receiver 

12 

2.83 


Excellent = 5.00 

Good = 4.00 

Satisfactory = 3.00 

Poor = 2.00 

Terrible = 1.00 



Table 7. Composite frequency and mean values of respondents’ ratings 8 


Training Method 

Frequency (f) 

Mean ( X) 

Vendor Schools 

202 

3.55 

Seminar Sessions 

546 

3.00 

CDE Tutorials 

300 

3.08 

OJT Training 

591 

2.54 


Excellent 

5.00 

Good = 

4.00 

Satisfactory = 

3.00 

Poor 

2.00 

Terrible = 

1.00 


Table 8. Survey opinions of trained people responding to the statement “Mark IVA training 
has helped me to perform Mark IVA related work in my job” 


Facility/ 

Group 

Strongly 

Agree 

Agree 

No Opinion 

Disagree 

Strongly 

Disagree 

DSCC 

8 

40 

16 

12 

2 

CMF 


7 

3 

2 


NOCC 


5 

2 

4 

4 

GCF 


3 

1 

1 


CTA-21 

1 

2 

2 

2 

2 

COE 

1 

7 

4 

1 


SCOE 


4 

1 

2 


PAG 



2 

1 

1 

Total 

10 

68 

31 

25 

9 


155 



Table 9. Chi square two-variable test of significance: relationship between types of training 

and rating responses 


Types 

of 

Training 


Rating Responses 3 



Total 

Excellent 

Good 

Satisfactory 

Poor 

Terrible 

Vendor 

10 

75 

62 

20 

5 

202 


(11.092) 

(48.189) 

(83.807) 

(46.833) 

(12.078) 


Seminar 

11 

134 

268 

120 

13 

546 


(29.981) 

(130.253) 

(226.528) 

(126.589) 

(32.646) 


CDE 

18 

92 

110 

60 

20 

300 


(16.473) 

(71.568) 

(124.466) 

(69.554) 

(17.937) 


OJT 

21 

90 

240 

180 

60 

591 


(32.452) 

(140.989) 

(245.198) 

(137.022) 

(35.337) 


Totals 

90 

391 

680 

380 

98 

1,639 


a Values in parentheses denote expected frequencies; other values denote observed frequencies. 
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= the expected value 


= sum of the ratio over both rows and columns 


degrees of freedom ( df ) = (r-l)(c-l) 


Test Result: At a significance level of a = 0.01, with df= 12, the obtained X 2 value of 209.817 
exceeds the critical value of 26.217 and the null hypothesis (HO) may be rejected. There is a 
statistically significant difference in types of Mark IVA training received by DSN technical 
personnel. 



Table 10. Chi square one-variable test of significance: goodness of fit between observed and 
theoretical opinion response distribution. Statement of opinion: “Mark IVA training has helped 
me to perform Mark IVA related work in my job.” 


Trained 

Respondents 


Strongly 

Agree 


Agree 


Opinion Responses 3 
No 

Opinion Dlsa « ree 


Strongly 

Disagree 


Total 


10 68 31 25 9 143 

(28.600) (28.600) (28.600) (28.600) (28.600) 


a Values in parentheses denote expected frequencies; other values denote observed frequencies. 

X 2 = 80.460 


X 


2 



%-fe? 

4 


where 

/ = the observed value 
J o 

f = the expected value 


t 

»= i 


sum of the ratio over k categories 


degrees of freedom (df) = {k - 1) 


Test Result: At a significance level of a = 0.01, with df- 4, the obtained x 2 value of 80.460 exceeds 
the critical value of 13.277 and the null hypothesis (HO) may be rejected. There is a statistically 
significant effect of Mark IVA technical training on DSN personnel ability to perform Mark IVA 
related work. 




Fig. 1. Percentage distribution of training 
survey responses: facility/group 



Fig. 2. Percentage distribution of trained vs untrained 
survey respondents: facility /group 



Fig. 3. Types of work performed by survey respondents: job categories 
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FREQUENCY, f FREQUENCY 




EXCELLENT GOOD SATISFACTORY POOR TERRIBLE EXCELLENT GOOD SATISFACTORY POOR TERRIBLE 


Fig. 4. Frequency curve comparison of antenna 
rating scores 


Fig. 6. Frequency curve comparison of command 
rating scores 
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Fig. 5. Frequency curve comparison of baseband 
assembly rating scores 
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EXCELLENT GOOD SATISFACTORY POOR TERRIBLE 



EXCELLENT GOOD SATISFACTORY POOR TERRIBLE 

Fig. 7. Frequency curve comparison of monitor 
and control rating scores 
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FREQUENCY, f FREQUENCY 



54321 54321 


EXCELLENT GOOD SATISFACTORY POOR TERRIBLE EXCELLENT GOOD SATISFACTORY POOR TERRIBLE 

Fig. 8. Frequency curve comparison of digital spectrum Fig. 10. Frequency curve comparison of ground 

processing rating scores communications rating scores 



54321 54321 


EXCELLENT GOOD SATISFACTORY POOR TERRIBLE EXCELLENT GOOD SATISFACTORY POOR TERRIBLE 

Fig. 9. Frequency curve comparison of frequency Fig. 11. Frequency curve comparison of local area 

and timing rating scores network rating scores 
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N$S SOFTWARE 
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GOOD SATISFACTORY POOR 


5 4 3 2 

EXCELLENT GOOD SATISFACTORY POOR 


Fig. 12. Frequency curve comparison of maser 
rating scores 


Fig. 14. Frequency curve comparison of network 
support subsystem rating scores 
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Fig. 13. Frequency curve comparison of microwave 
rating scores 


Fig. 15. Frequency curve comparison of precision 
power monitor rating scores 
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FREQUENCY, f FREQUENCY 



EXCELLENT GOOD SATISFACTORY POOR TERRIBLE EXCELLENT GOOD SATISFACTORY POOR TERRIBLE 


Fig. 16. Frequency curve comparison of receiver 
rating scores 


Fig. 18. Frequency curve comparison of test support 
subsystem rating scores 
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EXCELLENT GOOD SATISFACTORY POOR TERRIBLE 

Fig. 20. Frequency curve comparison of transmitter 
rating scores 
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Fig. 22. Percentage distribution of training effectiveness 
opinion scores: opinion categories 
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Fig. 23. Percentage distribution of positive/negative 
training effect responses 


Fig. 21. Frequency curve comparison of VLBI receiver 
rating scores 
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CLASSES SESSIONS TUTORIALS TRAINING 

Fig. 24. Types of training requested by untrained/poorly trained respondents: 

method categories 



EQUIPMENT SOFTWARE EQUIPMENT SOFTWARE 

Fig. 25. Training classes requested by untrained/poorly trained respondents: 

subject categories 


164 






^lt-3 


TDA Progress Report 42-83 


July-September 1985 


Error and Erasure Probabilities for Galileo Uplink Code 

J. B. Berner 

Telecommunications Systems Section 
R. J. McEliece 

California Institute of Technology 
E. C. Posner 

Office of Telecommunications and Data Acquisition 


The Galileo uplink Frame Erasure probability and Undetected Frame Error prob- 
ability are derived. The performance meets desired specifications under normal opera- 
tions. The Galileo command system will work well even in an emergency condition , 
where the bit error rate into the command decoder is 1.00 X 10~ 3 (although Galileo's 
command threshold error rate is LOO X 10~ 5 ). 


I. Introduction 

Galileo has a requirement for an undetected error rate for 
the End-to-End Command System of less than one undetected 
command error in 1 X 10 6 48-bit-long frames when the bit 
error rate into the CDU is 1 X 10 -5 (Ref. 1). This translates 
into a bit error rate of 2.08 X 10 -8 . While Galileo does not 
have any requirements on frame erasure rates, the draft 
Consultative Committee For Space Data Systems (CCSDS) 
command link coding recommendation is to have a 10 -3 frame 
erasure probability rate and a 10 -9 frame undetected error 
probability (Ref. 4). 

These requirements are achieved with two forms of error 
detection/correction coding. All command frames are encoded 
with a block code, and messages spanning more than one 
frame are protected with an additional parity byte, called 
the checksum byte. If, due to the uplink coding, these require- 
ments could be met at a higher input error probability, then 
the requirements on the signal-to-noise ratio (SNR) could be 


relaxed, which would allow more link margin. One purpose of 
this article is to analyze the effect that the uplink coding has 
on the channel error and erasure probabilities and to discover 
if any SNR savings can be found. A second purpose is to 
derive command error and erasure rates at the command 
threshold for use in making emergency commanding decisions. 


The code that the Galileo uplink channel is using is a 
shortened cyclic code with the following generator polynomial 
(Ref. 1): 

#(*) = X 1 +X 6 +X 2 + 1 = (X + 1) (X 6 + X + 1) (1) 


This generator polynomial gives a (63, 56) code. The version 
that Galileo uses is shortened to (47, 40) by filling the first 
sixteen bits of the longer code with 0’s. 


II. The Code 


i 



The second factor of the polynomial, (x 6 + x + 1), is the 
generator polynomial for the (63, 57) Hamming code. The 
first term, (x + 1), expurgates the code, i.e., it lessens the 
number of information bits by one and increases the number 
of parity bits by one. Thus, although the code can be thought 
of as a shortened BCH code (Ref. 1), the more useful way of 
describing it is as a shortened, expurgated Hamming code. 

A by-product of expurgating the code is that all codewords 
are even weight. This fact will be used later in determining 
the code’s error properties. 


where the row vector [0100000] is equal to the primitive 
element a , which is a zero of the polynomial x 6 + x + 1 
(Ref. 3). The /th column of H is equal to gia 1 ). Since the 
unshortened code is cyclic, we can rotate the matrix and 
get: 

H=[a\a s a 62 , a 0 ,..., a 6 ] (6) 

This is now in the form of Eq. (3). So we shorten and get: 

H" = [a 23 a 62 , a 0 a 6 } (7) 


There are several ways of viewing the code. The two most 
useful both use the parity check matrix, H . The first way 
looks at the Hamming code parity check matrix and the 
second way looks at the cyclic properties of the unshortened 
code. Both ways will be used to demonstrate various proper- 
ties and to obtain results. 


Thus, we can generate the necessary parity check matrix from 
the Galois field elements a *. Note that the two parity check 
matrices H ' and H n are equivalent under row reduction 
operations. 


It can be shown (Ref. 2) that the parity check matrix of the 
unshortened, expurgated code is: 


H ' = 


L -JL I 

i i i . . . i 


( 2 ) 


III. Error Properties of the Code 

Let us look at the code’s parity check matrix H' (Eq. [2]) 
and analyze the error properties. The code will correct one 
error and detect two errors when used as an error correcting 
code; it will detect three errors when operating as an error 
detecting code. 


where H is the parity check matrix of the (63, 57) Hamming 
code. Also, here the Hamming code is a linear code, of the 
form 

H = [BI n _ k ] (3) 

where / is the (n - k) X (n - k) identity matrix and B is a 
(n~k)X k matrix. Then, shortening# by t gives the following: 

H " = rv„-*] ( 4 ) 

where B t is B minus the first t columns (Ref. 2). This result 
is easy to justify, since shortening a code is just replacing the 
first t information bits in the long code with 0’s (and not 
sending these 0’s), which zeros out the first t columns of the 
parity check matrix. 

So the first goal is to get the shortened code into the form 
of Eq. (4). We do this by looking at the code in the second 
way, this time as a cyclic code. 


The received code word, Y , is equal to the transmitted 
codeword, X, plus the error pattern, Z. The syndrome of the 
received codeword is equal to the parity check matrix, H\ 
times the transpose of the received codeword. By definition 
of the parity check matrix, the syndrome of an unaltered 
codeword is the all 0 vector. Thus (Ref. 2), 

Syndrome = H f Y T 

= H\X t +Z t ) 

= h'x t +h'z t 
= h’z t 

So, we are only interested in the error patterns; the trans- 
mitted codeword does not affect the error properties. So 
from here on, for ease of calculation, we will assume that the 
all zero codeword is sent. 


The parity check matrix of a cyclic Hamming code can be 
written as: 

H = [a°,a l ,...,a 62 ] (5) 


There are two distinct flavors of error patterns: odd weight 
and even weight, where weight is defined as the number of 
l’s in the codeword or error pattern. For more than two 
errors and the parity check matrix //', the following is true: 
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Even Weight Error Pattern: 

(a) (b) 

x 0 

x 0 

tt' 7 T - X 0 

HZ " X 0 

x 0 

x 0 

0 0 

where x is either a 0 or a 1 ,Z T is the transpose of the received 
codeword, and (a) and (b) are the only possible even weight 
error pattern syndromes. 

The possible syndrome values for the Hamming code are 
the columns of the parity check matrix and the all 0 vector 
(the syndrome of a codeword) (Ref. 2). Since the parity 
check matrix H f has all l’s in its last row, the only even 
weight error patterns that will escape detection are the ones 
that are codewords. Thus, the code will detect error patterns 
with syndromes of pattern (a) and will not detect error pat- 
terns with syndromes of pattern (b). 

Odd Weight Error Pattern: 

(c) (d) 

x 0 

x 0 


x 0 

x 0 

1 1 

If an odd weight error pattern occurs, the above syndromes 
are the only possible. The code will detect error patterns with 
syndromes of pattern (d), since the parity check matrix has 
no columns of this form, and will not detect error patterns 
with syndromes of pattern (c), unless the code is shortened. 
If the code is shortened, error patterns with syndromes equal 
to the zeroed out parity check matrix columns will be 
detected. 

So, to determine the error statistics (how many detected 
and how many not detected for weight /), we must take a 
different approach for the even and odd weight errors. For 
the even weight errors, all we need is the weight enumerator 
(the number of words of weight I for all /) of the code; for 
the odd weight errors, we will have to do more work. 


A. Even Weight Errors 

There are 2 40 possible code words; thus, counting the 
weights of the codewords borders on the impossible. How- 
ever, using the dual code, the weight enumerator of the 
code can easily be found. 

The dual code of a code is the code produced when using 
the parity check matrix as the generating matrix. This gives a 
code with 2 7 = 128 codewords, easily countable with a com- 
puter. Then one can use the MacWilliams Identities (Ref. 2) 
to get the weight enumerator of the code from the weight 
enumerator of the dual code. The weight enumerator then 
gives the number of undetectable errors of weight I. Subtract 
the undetectable errors from the total number of errors of 
weight /, (j 7 ), and we have the number of detectable even 
weight errors. The work is thus half done. 

B. Odd Weight Errors 

In the Galileo uplink, the code is used in two modes, error- 
detect (ED) and error-detect-and-correct (EDC). In error- 
detect mode, the code is used as an error detecting code; it 
does not try to correct the errors. This allows the code to 
detect all error patterns of weight three or less. In error-detect- 
and-correct mode, which is used only on data frames, the code 
is used as an error correcting code; thus, it can correct all one- 
error patterns and detect all two-error patterns. 

In the error-detect mode, only even weight errors with the 
all 0 syndrome (patterns that are codewords) escape detec- 
tion. Since the code has no odd weight codewords, if the code 
is operated in error detect mode, there are no undetectable 
odd weight errors. 

However, if the code is operated in error-detect-and-correct 
mode, the situation is very different. The code will make an 
error if the error pattern causes a syndrome that is a column in 
the parity check matrix, i.e., the code assumes a single error 
has been made. When the code assumes a single error has been 
made, it will try to correct the error. The correction attempt 
changes one bit in the error pattern; this new bit may cancel 
out one error bit or it just adds one error bit. Thus, to generate 
an error pattern of weight 2K + 1 , there are 2K + 2 ways of 
canceling a bit of a codeword of weight 2K + 2 and there are 
47 - 2 K ways of adding a bit to a codeword of weight 2 K. 
So, the formula for the undetectable errors of weight 2K + 1 
is: 

U = (47 - 2K) X A 2K + (2 X + 2) X A 2K+2 (8) 

where A i is the number of codewords of weight /. 
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Once again, the number of detectable errors is the number 
of error patterns of weight / minus the number of undetect- 
able errors. 

The weight enumerator, the number of detectable and 
undetectable errors, and the details of the calculations are 
given in Appendix A. 

The next task is to compute for a given input (to the code) 
symbol error probability, /?, the output frame error and era- 
sure probabilities. This is straightforward: 

For the error-detect-and-correct mode, 

" . 47-/ 

U , « 

1=2 

'’erase = E P'd-P) 4 ™^ 00) 

1=2 

where U t and D t are the error-detect-and-correct mode unde- 
tectable and detectable errors of weight /, respectively. 

For the error-detect mode, 

o') 

i=l 

'’error = E P'd-P) 4 ™^ 02) 

1=1 

where U\ and D\ are the error-detect mode undetected and 
detected errors of weight /, respectively, as described above. 

For an input symbol error of 1.00 X 10“ 5 , the output 
probabilities are as follows. For error-detect-and-correct, 

P = 1.170 X 10 _u 

error 

P = 1.081 X 10 -7 

erase 

For error-detect, 

P = 2.926 X 10 -17 

error 

P = 4.699 X 1CT 4 

erase 

Figures 1 and 2 are plots of the error and erasure probabili- 
ties versus the input channel error probability for the error- 


detect-and-correct mode (Fig. 1) and the error-detect mode 
(Fig. 2). We see that the error-detect-and-correct mode pro- 
vides error rates of 10 -5 to 10~ 14 for p = 10“ 3 to 10~ 6 , 
while the error-detect mode provides error rates of 10 -9 to 
1(T 21 for the same range of p. 

IV. The Command Frame 

A Galileo command frame is 48 bits long. It is equal to the 
47-bit codeword, with a 0 fill bit appended to the end to 
make the frame length be a multiple of eight bits. The frame 
format (Ref. 1) is shown in Fig. 3. 

There are two types of command frames, Single Frames and 
Multiple Frames (Ref. 1): 

(1) Single Frame - A single command frame, decoded in 
error-detect mode. 

(2) Multiple Frames - A header frame, called the Block 
Command frame , which is decoded in error-detect 
(ED) mode, followed by 1 to 31 Data frames, decoded 
in error-detect-and-correct (EDC) mode. The last 
information byte of the last data frame is the check- 
sum byte , which is the result of exclusive -O Ring all 
the previous information bytes. After decoding the 
data frames, the parity bits are discarded and the 
information bytes are exclusive-ORed. If the result is 
nonzero, an erasure is declared. 

Thus, there will be two sets of error and erasure probabilities, 
one for the Single Frames and one for the Multiple Frames. 

A. Single Frames 

The Single Frame is just a codeword decoded in the error- 
detect mode. The resulting error and erasure probabilities are 
shown in Fig. 2. For an input symbol error probability of 
1.00 X 10“ 5 ,the Single Frame probabilities are: 

P = 2.926 X 10“ 17 

error 

P = 4.699 X 10 -4 

erase 

From Fig. 2, we see that the coding provides error rates that 
are at least 10~ 8 below the erasure rates. 

B. Multiple Frames 

Before finding the required probabilities, we must under- 
stand how the overall decoding system (Hamming Code 
decoder and checksum byte) works. 

The Block Command frame is decoded. If errors are de- 
tected, processing of the Multiple Frame stops and an erasure 
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is declared. If no errors are detected, the Data frames are 
decoded. If an uncorrectable error is detected, processing of 
the Multiple Frame stops and an erasure is declared. If all 
frames are decoded without an erasure, the data bytes (the 
40 information bits per Data frame) are exclusive -0 Red, and 
if the result is nonzero, the processing is stopped and an 
erasure is declared. The last data byte of the last Data frame is 
called the checksum byte , since this byte is appended onto 
the data stream to make the exclusive-ORing of the data 
bytes be zero (Ref. 1). 

Since the code and checksum are linear, any frame can be 
used for the analysis. So we will assume that the all zero frame 
is sent; thus, a 1 denotes an error. 

Assume that the codeword has passed through the decoder. 
We now drop the 7 parity bits and only consider the 40 infor- 
mation bits (five information bytes). If we break each byte 
into its 8 bits and look at each bit position (or slot) in the 
byte, two things are obvious: 

(1) If there is an odd number of Ps in any slot, the 
exclusive-ORing process will result in a 1 being in that 
slot; thus, an erasure will be declared. 

(2) If there is an even number of 1’s in each slot, the 
exclusive-ORing process will result in a 0 being in that 
slot; so, no error will be detected. 

Thus, for an error pattern to escape detection, there must be 
an even number of l’s in each slot. 

Now, the statistics of the shortened, expurgated Hamming 
code are such that if the decoder makes an error, it outputs 
even weight error patterns of weight four or more. And, as 
was shown above, if there is an odd number of channel errors 
that the decoder cannot correct or detect, the decoder outputs 
either one less error or one more error. Thus, the minimum 
number of channel errors at the input to the decoder to cause 
an error that is undetectable (or uncorrectable) by the decoder 
is three. So the probability of an error that is undetectable 
by the checksum is proportional to /? 3 , for small/?. 

Since we have multiple data frames, the question is, do we 
worry about multiple frame errors, or do we just look at a 
single frame in error? The probability of a multiple undetected 
frame error would be equal to C X p 6 + OC ) (since p 3 is the 
minimum for a single frame), where C is a constant. Since p 
is less than 10 -3 , the probability of a double frame error is, 
at the least, 10“ 9 less than the probability of a single frame 
error. Thus, we can ignore all multiple data frame errors and 
concentrate on undetected single data frame errors. And, 
since we are dealing with a low p, the number of undetectable 
combinations we have to look at is small. 


The undetectable error patterns are those with an even 
number of Ps in each slot. This only occurs in error patterns 
with an even number of l’s in the information bits. 

There are 80 possible undetectable weight 2 information-bit 
error patterns. The corresponding codeword weights are (see 
Appendix B for the derivation): 


37 

weight 4 

32 

weight 6 

11 

weight 8 

There are 2840 possible undetectable weight 4 information-bit 
error patterns. The corresponding codeword weights are: 

37 

weight 4 

892 

weight 6 

1591 

weight 8 

320 

weight 10 

There are 58800 possible undetectable weight 6 information 
bit error patterns. The corresponding codeword weights are: 

924 

weight 6 

19253 

weight 8 

32244 

weight 10 

6379 

weight 12 


Before we begin, some symbols that we will use: 

P^ D = Probability that the decoder declares an erasure 
in ED mode 

ptvc _ probability that the decoder declares an erasure 
in EDC mode. 

= Probability that the decoder makes an error in 
ED mode 

pEE>c _ probability that the decoder makes an error in 
EDC mode 
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With the above numbers in hand, and with the knowledge that 
the code converts odd weight error patterns into even weight 
patterns, we can calculate the probability that one frame will 
have an error pattern that is undetectable by the checksum 
(called P u ), given that the decoder made an error. 


P 


u 


I sum of (the number of patterns of weight 
\ i that are undetectable) 

y P 1 'X(1-P) H ) 

pEDC I 
r E 


(45 X 0 + 4 X (37 + 37)) X p 3 X (1 -p) 

E 


44 


+ (37 + 37) X p 4 X (1 -p) 43 

pEDC 

E 



+ (43 X (37 + 37) + 6 X (32 + 892 + 924)) 

if* 


X p s X (1 -p) 42 

+ 0(p 6 ) 

pE E DC 


P _ (296p 3 (1 -p) 44 +74p 4 (1 -p) 43 + 14270p 5 (1 -p) 42 ) 
« pEDC 


(14) 

And the probability of a frame having a detectable error by 
the checksum (P d ), given that the decoder made an error, is: 


P d = 1 ~ P u ( 15 > 

And we will assume that we have n data frames, where n is 
between 1 and 31 . 


Now let’s calculate the erasure probability of the system, 
remembering that an erasure stops the processing: 


Prob (erasure in Block Command frame) 

+ Prob (erasure in one of the n data frames) 
+ Prob (checksum declares erasure) 


'’erase = ^ + ( 1 X ^ 


ED\ v z>EDC 


X J] (1 -pEoey-i 
1=1 


>06) 


+ (” ) X Pj X (! _ pEDC _ pEDC )n -l 


X (1 -pE°)xpE DC 

And, the error probability (again assuming one undetectable 
error): 


P^or = P r °b (error in Block Command frame) 

+ Prob (undetectable error in data frame) 


Pf D X (1 -pE° C -P£ DC ) 


iEDC pEDC\n 
E “ R 


+ (1 - P 


iED 


-1°)X (") 


XP 


(17) 


X (1 -P™ c -P^ DC )" _1 x p| DC 


The resulting probabilities are plotted in Figs. 4, 5, and 6, for 
n = 5,10, and 31 . For a channel error probability of p = 1CT 5 , 
the results are: 

For n = 5, 


P = 1.48 X10 -12 

error 


P = 4.70 X 10~ 4 

erase 


For n = 10, 


For n = 31 , 


P = 2.96 X 10 -12 

error 


P = 4.71 X 10 -4 

erase 


9.17 X 10 -12 


P = 4.73 X 10 -4 

erase 
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V. Examining the Results 

Let us assume the CCSDS requirements (10~ 3 frame erasure 
probability and 10“ 9 frame undetected error probability). At 
least for now, we will assume these requirements for the 
Multiple Frame. So, using Figs. 2, 4, and 5, we get the follow- 
ing undetected error probabilities at an erasure probability 
of 10 -3 : 

For n = 5, 

P =1.00X10" n 

error 

For n = 10, 

P =2.50X10" n 

error 

For n- 31, 

P = 8.00 X 10 -11 

error 


errors = /) X Prob (number of frame errors = /). For each i, 
the summed terms are bounded by: 



At p = 10" 3 , P^ DC = 1.1 X 10~ 5 . The later terms in the 
summation are thus insignificant when compared to the first 
term (/ equals 1). Thus the equation forP erase (Eq. [16]) holds 
at/? = 10 -3 . 

The probability of error is even easier. The probability,/^, 
of an undetectable error, given that a frame error has occurred, 
is the summation over i of D X (/? 3 )*, where / is the number of 
frames that have errors and D is a constant that depends on 
i. With p = 10~ 3 , only the first term (/ equals 1) is significant. 
So the equation for/> error (Eq. [17]) holds. 

The equations give the following numbers for p = 10~ 3 : 


Single Frame: 


These values occur at a channel error probability of 2.00 X 
10 -5 or 1 .00 X 10~ 4 * 70 , which gives an E b /N 0 improvement of 
0.33 dB over the E b jN 0 required for a 1.00 X 10 -5 channel 
error probability. 

Now, let us consider the n = 31 case (this has the highest 
error probability). The error probability is equal to 1.00 X 
IQ-10.09691 j^ s means we ^0 one f rame i n error f or every 
10io.O969i f ram es. At 32 bits per second, and 48 bits per 
frame, that means that it will take 594 years for an error to 
occur. Or, to put it another way, we could have started trans- 
mitting commands continuously when Galileo was alive in 
the mid 1600’s and still would not expect an error until 
sometime in the twenty-third century (Jim Taylor, private 
communication). 


VI. Command Threshold 

We now want to look at what happens at the command 
threshold. The command threshold is assumed to be the point 
where the input symbol error rate, /?, is 1 .00 X 10“ 3 . 

In Section IV, we made an assumption that since the 
symbol error rate would be less than 10“ 3 , we only had to 
worry about one frame in error when we have a multiple 
frame command. Since we are at p = 10~ 3 , we should look 
at this again: 

For the probability of erasure, the only term affected 
is Prob (< checksum declares erasure). This term is equal to the 
sum of Prob (< checksum declares erasure | number of frame 


4.6 X 1CT 2 


P = 2.8 X 1(T 9 

error 


Multiple Frame: 

* = 5, 


n = 10, 


n =31, 


= 5.0 X 1(T 2 
= 1.3 X 10‘ 6 
= 5.5 X 1CT 2 
= 2.7 X 10~ 6 
= 7.6 X 1CT 2 
= 8.1 X 10 _6 


So, even in the worst case (n = 31), in an emergency, only 
7.6% of the frames would get erased and more importantly, 
those that get through the decoder have an error probability 
of 8.1 X 10~ 6 . This means that it is safe to blind command 
(the sending of commands without any hope of the space- 
craft verifying them) Galileo in case of a spacecraft emergency. 


VII. Summary 

The Galileo uplink frame erasure and undetectable frame 
error probabilities have been derived. It has also been shown 
that the Expurgated Hamming code with checksum byte 
gives better than required error protection for a given 
erasure probability. 
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Fig. 4. Probabilities for multiple frames where n = 5 
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Appendix A 
Code Statistics 


The goal is to find, for each error pattern weight, the num- 
ber of detectable and undetectable error patterns. To do this, 
we must first find the weight enumerator of the code. 

The weight enumerator is found via the dual code of the 
code. The dual code is the code created by using the parity 
check matrix of our code as a generator matrix. This creates a 
(47, 7) code, which has only 2 7 = 128 codewords. The weight 
enumerator of this code is easily found by computer by 
generating the 128 7-bit sequences, encoding them with the 
parity check matrix, and then counting the l’s in each code- 
word. The results of this are in Table A-l . 


As was discussed in Section III, the only undetectable even 
weight error patterns are those that are codewords. Thus, for 
errors of weight 2/, the number of undetectable and detect- 
able patterns are: 


Undetectable = A(2i) (A-2) 

Detectable = | 47 J -A(2i) (A-3) 

And, as was shown in Section III, the number of odd weight 
detectable and undetectable error patterns is: 


The next step is to use the MacWilliams identities to calcu- 
late the weight enumerator of the code. The MacWilliams 
identities state (Ref. 2) that if B(z) is the weight enumerator 
of an ( n , k) linear code and A (z) is the weight enumerator of 
its dual code, then: 


Undetectable = (47 - 2i) X A (2 /) + (2/ + 2) X A (2/ + 2) 

(A-4) 

Detectable = L*?) - (47 - 2/) X A (2i) 


A(z) = 2~ k J2 V 1 - z )'0 + Z T~‘ (A-D 
1=0 

In our case, k = 7, « = 47, B(z) is the weight enumerator of 
the dual code, and A (z) is the weight enumerator of the code. 
So, again using a computer, the weight enumerator can be 
calculated. The results are shown in Table A-2. Now we can 
calculate the number of detectable and undetectable error 
patterns of weight /. First, let’s do it for the EDC mode. 


- (2/ + 2) X /I (2/ + 2) (A-5) 

The results are shown in Table A-3. 

For the ED mode, the even weight error pattern breakdown 
is the same. The difference is in the odd weight error patterns. 
Since we are in ED mode, errors that look like single errors 
are detected, not corrected. So, there are no undetectable 
error patterns of odd weight. These results are in Table A4. 
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Table A-1. Dual code weight enumerator 


Table A-3. Error statistics (EDC mode) 


Weight Number of Words 


0 

1 

19 

3 

20 

4 

21 

5 

22 

23 

23 

28 

24 

28 

25 

23 

26 

5 

27 

4 

28 

3 

47 

1 


Table A-2. 

Weight enumerator 

Weight 

Number of Words 

0 

1 

2 

0 

4 

2927 

6 

167017 

8 

4916447 

10 

80897478 

12 

816454377 

14 

5338125069 

16 

23488120074 

18 

71384955784 

20 

152538959670 

22 

231779439554 

24 

251934559006 

26 

196121173412 

28 

108956243986 

30 

42831113394 

• 32 

11743967013 

34 

2198099208 

36 

272132459 

38 

21294613 

40 

981971 

42 

24070 

44 

245 

46 

1 


Weight 

Detectable 

Undetectable 

1 

47 

0 

2 

1081 

0 

3 

4507 

11708 

4 

175438 

2927 

5 

405976 

1127963 

6 

10570556 

167017 

7 

16712226 

46179273 

8 

309541048 

4916447 

9 

361932932 

1000716213 

10 

5097169273 

80897478 

11 

4626474407 

12790659210 

12 

51434946474 

816454377 

13 

37367194284 

103309654161 

14 

336305649726 

5338125069 

15 

199648256088 

551968048461 

16 

1479744489024 

23488120074 

17 

728127949008 

2013060926406 

18 

4497263169906 

71384955784 

19 

1852256859654 

5120942911136 

20 

9609940719436 

152538959670 

21 

3334060006144 

9217699581278 

22 

14602118254672 

231779439554 

23 

4282886436556 

11840915404994 

24 

15871867282544 

251934559006 

25 

f 3940252328376 

10893645365850 

26 

12355638414010 

196121173412 

27 

2593160205846 

7169319473260 

28 

6864243526804 

108956243986 

29 

! 1213546088136 

3355102037554 

30 

i 2698357762020 

42831113394 

31 

399296736984 

1103935872114 

32 

739872337536 

11743967013 

33 

90748896528 

250894878267 

34 

138478749237 

2198099208 

35 

13879342623 

38372058228 

36 

17145001158 

272132459 

37 

1375414408 

3802652343 

38 

1341354532 

21294613 

39 

83527138 

230930357 

40 

61909528 

981971 

41 

2852836 

7884737 

42 

1509869 

24070 

43 

47235 

131130 

44 

15970 

245 

45 

300 

781 

46 

46 

1 

47 

0 

1 
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Table A-4. Error statistics (ED mode) 


Weight 

Detectable 

Undetectable 

1 

47 

0 

2 

1081 

0 

3 

16215 

0 

4 

175438 

2927 

5 

1533939 

0 

6 

10570556 

167017 

7 

62891499 

0 

8 

309541048 

4916447 

9 

1362649145 

0 

10 

5097169273 

80897478 

11 

17417133617 

0 

12 

51434946474 

816454377 

13 

140676848445 

0 

14 

336305649726 

5338125069 

15 

751616304549 

0 

16 

1479744489024 

23488120074 

17 

2741188875414 

0 

18 

4497263169906 

71384955784 

19 

6973199770790 

0 

20 

9609940719436 

152538959670 

21 

12551759587422 

0 

22 

14602118254672 

231779439554 

23 

16123801841550 

0 

24 

15871867282544 

251934559006 

25 

14833897694226 

0 

26 

12355638414010 

196121173412 

27 

9762479679106 

0 

28 

6864243526804 

108956243986 

29 

4568648125690 

0 

30 

2698357762020 

42831113394 

31 

1503232609098 

0 

32 

739872337536 

11743967013 

33 

341643774795 

0 

34 

138478749237 

2198099208 

35 

52251400851 

0 

36 

17145001158 

272132459 

37 

5178066751 

0 

38 

1341354532 

21294613 

39 

314457495 

0 

40 

61909528 

981971 

41 

10737573 

0 

42 

1509869 

24070 

43 

178365 

0 

44 

15970 

245 

45 

1081 

0 

46 

46 

1 

47 

1 

0 
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Appendix B 

Undetectable Information-Bit Error Patterns 


The only way for errors to escape detection by the check- 
sum byte is to have an even number of errors in each bit slot. 
Since there are 5 information bytes per Data frame, there are 
5 different bits per bit slot. We are only interested in the 
undetectable patterns with 2, 4, and 6 information bits in 
error. 


(KMKM3-™ 

So, there are 2840 possible four information bit patterns. 
Again a computer was used to generate the codeword weights, 
using the same method as before. The results are: 


I. Two Information Bit Errors 

The only way to get an undetectable error pattern with two 
information bits in error is to have both bits in the same slot. 
That means that there are (^) ways to do this in each slot and 
that there are (^) slots to do it in. So: 

(K)-» 

There are 80 possible two information-bit error patterns that 
will escape detection. To find the codeword weights, a com- 
puter was used; each pattern was generated, encoded, and then 
“weighed” (the number of l’s counted). The results are: 

37 weight 4 

32 weight 6 

1 1 weight 8 


37 

weight 4 

892 

weight 6 

1591 

weight 8 

320 

weight 10 


III. Six Information Bit Errors 

There are two types of six information-bit error patterns 
that escape detection. The first has three slots with two errors 
in each slot. There are (2) ways per slot and (3) slots to do it 
in. The second way has four errors in one slot and two errors 
in another. There are (|) ways to do it in the four error slot 
and (2) ways to do it in the two error slot; there are 8 X 7 
slots to do it in. So: 


8 X 7 X 


(4) x (2 ) + ( 3 ) x (2) x (2 ) x (2 ) = 58800 


II. Four Information Bit Errors 

There are two types of four information-bit error patterns 
that escape detection. The first is all four errors in one slot. 
There are (4) ways per slot to do this and (^) slots to do it 
in. Secondly, there could be two sets of slots with two errors 
in each. There are (9) ways per slot and (9) slots to do it in. 
Thus: 


Thus, there are 58800 undetectable six information-bit 
error patterns. Using the same methods as above, the code- 
word weights were calculated. The results are: 

924 weight 6 

19253 weight 8 

32244 weight 10 

6379 weight 12 
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A Wide-Band, High-Resolution Spectrum Analyzer 
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This article describes a million-channel 20 MHz-bandwidth , digital spectrum analyzer 
under development at JPL for use in the SETI Sky Survey and other applications in the 
Deep Space Network. The analyzer digitizes an analog input , performs a 2 20 -point, 
Radix-2, Fast Fourier Transform, accumulates the output power, and normalizes the out- 
put to remove frequency-dependent gain. The effective speed of the real-time hardware is 
2.2 GigaFLOPS. 


I. System Overview 

A. Spectrum Analyzer Description 

This article describes a wide-band, high-resolution, digital 
spectrum analyzer design for use in the Search for Extrater- 
restrial Intelligence (SETI), spacecraft telemetry, radio astron- 
omy, planetary radar, Radio Frequency Interference (RFI) 
monitoring, and frequency analysis of wide-band systems in 
the Jet Propulsion Laboratory’s Deep Space Network. The 
primary radio astronomy user will be the Search for Extra- 
terrestrial Intelligence (SETI). The analyzer samples an input 
signal with up to a 20 MHz IF bandwidth, performs contig- 
uous real-time Fast Fourier Transforms (FFTs) of up to 
1,048,576 = 2 20 points corresponding to a resolution of 
20 Hz. Special-purpose digital hardware provides real-time 
processing of the output spectra, including power accumula- 
tion, baseline rectification, matched filtering, and thresholding. 

The output spectra can be recorded, displayed, and sent to 
a processing computer over a high-speed data bus. The system 
is microprocessor controlled, software reconfigurable, and 
includes built-in module and system -level diagnostics. The 
unit will be one seven-foot rack for the high-speed digital hard- 


ware plus a half rack for the analog components, and a work- 
station computer for system control, spectrum displays, and 
post-processing. 

The system contains two RF input channels, enabling dual- 
polarization analysis or the simultaneous analysis of two 
analog input channels. 

The various components of the system are described below. 
Table 1 lists all the modules in the spectrum analyzer system. 

B. System Block Diagram 

Figure 1 is a functional block diagram of the spectrum 
analyzer system. The Intermediate Frequency (IF) signals 
come into the IF Input Signal Conditioner where they are 
mixed to baseband and sampled at the desired sampling fre- 
quency. The resultant digital samples are complex numbers 
with a total of 16 bits, 8 bits real and 8 bits imaginary. 

The Input and Timing module collects sufficient data for a 
spectrum in one of the input buffers, implements the delay for 
the first stage of an iV-point FFT, then sends the delay pairs to 
the window module. The Input and Timing module also gener- 
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ates all the synchronization signals for the spectrum analyzer 
system. The Window module applies a real, symmetric window 
to the data to broaden the main lobe of the frequency response 
and suppress the sidelobes. An FFT is then performed on the 
windowed data. Each FFT stage performs an FFT butterfly 
operation and then implements the delay for the next stage. 
It is also possible to transform two channels simultaneously, 
by putting one real channel into the real components and 
another real channel into the imaginary components of the 
complex FFT. The two channels are sorted out in the Real- 
Adjust board of the FFT processor. An unscrambler module 
bit-reverses the frequency bin indices of the FFT output so 
that the output data are in natural order. 

The final FFT data then goes to the power accumulator 
which calculates the power of the complex spectrum and 
samples and accumulates them on a frequency-by-frequency 
basis. There are actually two independent accumulators so that 
two separate data streams can be accumulated. The accumu- 
lated power spectra are then baselined to remove frequency- 
dependent system gain. The baseline is derived from an expo- 
nentially updated accumulation for each frequency. Again two 
baseline accumulation memories are needed for the separate 
accumulations. 

The final processing involves combining successive spectra 
using a five-coefficient filter which operates on a frequency- 
by-frequency basis. This spectrum filter can be a matched 
filter to any desired single-frequency time signature of dura- 
tion equal to five accumulation intervals. For example, as a 
source transits across an antenna beam, its amplitude traces 
the shape of the antenna beam response as shown in Fig. 2. If 
the coefficients of the spectrum filter are chosen to match the 
beam shape, the filter acts as a matched filter for transit 
sources. The output of the spectrum which passes a threshold 
test is then sent to the Spectrum Processor. 

An output processor is used to select data for display on the 
system graphics display. The data can be from the spectrum 
filter or from the baseline module. The output processor can 
be used for test output by bypassing all the modules between 
it and the module under test. The spectrum analyzer system is 
controlled by the microprocessor computer system whose 
primary function is data processing and graphics handling, 

C. Configuration, Control and Post Processing 

The system controller and post processor will be a micro- 
processor-based computer system with high-resolution graphics, 
and sufficient storage and processing power to control and 
configure the spectrum analyzer, and perform additional data 
processing on the output spectra. The computer system will 
generate graphics displays, archive data, provide antenna moni- 
toring and control, and perform special-purpose processing. 


Examples of special-purpose processing include signal identi- 
fication, signal tracking, and the removal of undesired interfer- 
ing signals. 

The spectrum analyzer can be configured by a few dozen 
control bytes in the memory address space of the control 
microprocessor. Configuration parameters which can be 
changed include the sampling rate, whether the input is dual- 
channel or single-channel, real or complex, the length of the 
FFT, accumulation frame lengths, the baseline decay factor, 
the length of the spectrum filter, and the processing of the 
output data. The RAM coefficient memories for the window, 
matched filter, or initial baseline can be read in from the 
control microprocessor. Any module can be bypassed during 
operation or testing. 

Each module of the analyzer is designed to support self- 
tests and diagnostics. Data vectors can be read into or out of 
any module for testing. The test output vectors are compared 
to the expected response to check the performance of the 
board. Since any module can be bypassed as the controller 
chooses, each module can be tested in isolation or with any 
combination of other modules. The executive board is con- 
trolled to generate test synchronization signals, and transmit 
and receive test vectors through the executive board buffers. 
The test software will reside in the control computer. 

D. Hardware Description 

The hardware design of the megachannel analyzer is based 
on design experience with previous instruments of a similar 
nature. The 65,536-channel spectrum analyzer (Refs. 2, 3) is 
used for radio spectroscopy, Radio Frequency Interference 
(RFI) surveillance, to aid the DSN in trouble-shooting, and for 
the SETI All-Sky Survey (Refs. 4, 5). Recently a digital con- 
volver was developed to process Synthetic Aperture Radar 
(SAR) data. The SAR processor contains two forward FFTs 
and two inverse FFTs, each 16,384 points long. 

The new megachannel analyzer prototype will use TTL 
logic on large 16-inch by 17-inch wirewrap boards with eight 
boards in a cage. The entire system will be housed in a single 
7-foot rack. Extensive use is made of the TRW TDC1022 
22-bit floating-point adders and AMD MPY01 6-type 16-bit 
multipliers. The machine processes 20 complex megasamples 
per second and performs more than 2.2 GigaFLOPS. 


II. Module Descriptions 

Table 1 lists all the modules in the spectrum analyzer sys- 
tem. Except for the Output Buffer and Interface Board, all 
the modules are described below. 
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A. Intermediate Frequency Input Signal Conditioner 

The IF Input Signal Conditioner filters and samples the 
analog input data to provide digital samples for the spectrum 
analyzer. Figure 3 shows the block diagram for one of the 
two IF sections. The input is bandpass filtered to a 20 MHz 
bandwidth and 55 MHz center frequency. An attenuator is 
used to adjust the IF level. This signal is downconverted to 
baseband by the complex mixer. The 3 dB points of the 
inphase and quadrature low-pass filters are at 10 MHz. These 
filters are matched in gain and phase to provide image rejec- 
tion of greater than 30 dB. The complex baseband signal is 
sampled at 20 MHz by the 8-bit Analog-to -Digital Converters 
(ADCs). Synthesizers generate the sampling frequency and 
center frequency reference tones. 

Two IF Channels can be processed simultaneously by the 
spectrum analyzer, but the maximum bandwidth is 10 MHz, 
half the maximum for a single input. Each signal is applied to 
the input of a complex mixer and the ADCs sample one of 
the arms of each mixer. Thus one of the real sampled signals 
is in the real components and the other is in the imaginary 
components of the complex FFT input. Since the spectrum 
of the real component is conjugate symmetric and the spec- 
trum of the imaginary component is conjugate antisymmetric, 
the two signals can be separated by forming the conjugate 
symmetric and antisymmetric components of the output 
spectra. This operation is performed in the Real-Adjust Module. 

For sampling frequencies F s other than 10 or 20 MHz band- 
width, filters with adjustable bandwidths are used after the 
matched low-pass filters. The current design does not allow for 
sampling rates greater than 20 MHz, but this could be imple- 
mented by adding a higher bandwidth IF section, faster ADCs, 
and a fast input buffer which would read into the current 
input buffers at 20 MHz. Contiguous spectra could not be 
processed at a rate higher than 20 MHz, so the duty cycle 
would be the ratio of the fast sampling rate to the 20 MHz 
processing rate. 

B. Input and Timing 

The Input and Timing module triple buffers the input data 
using three, 2-Mbyte RAM buffers, implements the delay 
operation for the first stage of the FFT, and generates all the 
synchronization signals for the spectrum analyzer. The syn- 
chronization signals, explained below, include the start-of- 
spectrum indicator, valid spectrum indicators, and frame trig- 
gers. The synchronization signals are sent down the processing 
pipe on two serial lines. Each module delays the synchroniza- 
tion signals by an amount equal to the module pipe delay 
before sending the signals to the next module in the pipe. 


The current buffer is read out by the delay commutator 
which outputs pairs of complex data samples, *(/:) and 
x(k + N/2), 0 <k<N/2 - 1 which are to be combined in the 
first butterfly stage of an Appoint FFT. The start -of-spectrum 
indicator coincides with k = 0 and occurs every N samples, 
or every Nj 2 sample pairs. Because of the periodicity of the 
delay commutator, the beginning of a new spectrum can occur 
only every N samples times. Thus, if the sampling rate is less 
than the 20-MHz processing rate, and the next buffer is not 
full when the commutator is reset to k = 0, N ticks of the 
20-MHz processor clock must be skipped before the buffer can 
begin to be processed. The first two time lines in Fig. 4 show 
the write and read times for a 16 MHz sampling rate. Since the 
sampling rate is four-fifths the processing rate, every fifth 
spectrum does not contain valid data, and a valid spectrum 
indicator does not appear in the third time line. Since the 
processing pipe cannot be stopped to wait for the buffer to 
fill, the modules continue cycling through their processing, but 
the absence of the valid spectrum indicator prevents the data 
from being added into the accumulation, used to update the 
baseline, or entered into the spectrum filter. 

The frame trigger signals control the lengths of the spec- 
trum accumulations. The bottom time line in Fig. 4 is for 
accumulation frames of 3 spectra. Since two input channels 
can be processed simultaneously there are two separate accu- 
mulator memories. The valid spectrum indicator identifies 
which accumulation each spectrum belongs to, and there are 
two frame triggers, one for the a accumulator and one for the 
j3 accumulator so that they can be controlled independently. 
For dual-channel input, the Real-Adjust module interleaves a 
spectrum of the real input with a spectrum of the imaginary 
input. Thus the even-numbered spectra belong to the real 
channel and are accumulated separately from the odd spectra 
which belong to the imaginary channel. 

Dicke switching also makes use of the two separate accumu- 
lators. In Dicke switching the antenna switches from looking 
at a source for K spectra, to looking at the noise for K spectra. 
The switching is driven in synchronization with the spectrum 
analyzer. A counter can be set to discard a specified number of 
samples to allow synchronization with a pulsing signal, or set- 
tling time for the Dicke switch. 

C. Executive Board 

The Executive board generates the clock signals for the 
high-speed digital components. It also contains a test input 
buffer and response buffer which are read only and write only 
respectively to the microprocessor bus. The buffers are in the 
memory address space of the microprocessor. Test data vectors 
are generated by the microprocessor and written to the test 
input buffer at microprocessor speed and then transferred to 
the Input and Timing module at the full hardware processing 
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speed. The Executive board generates the appropriate test 
synchronization signals as commanded by the microprocessor. 
Test output vectors are returned to the microprocessor via the 
Response Bus and Response Buffer. The Response buffer is a 
First-In-First-Out (FIFO) buffer. The data streams through 
until a programmed stop signal freezes the contents. The con- 
tents can then be read out and analyzed by the microprocessor 
at its slower processing rate. 

Test vectors can be applied to any module or group of 
modules in the spectrum analyzer by bypassing all preceding 
boards in the pipe so that the test vectors are passed on 
unchanged to the input of the first board under test. Every 
module has the ability to send output on the Response Bus to 
the Response Buffer. The bypass data path is 46-bits wide to 
accommodate 44-bit data vectors plus two synchronization 
lines. 

D. Window Module 


only 1.4 dB down from the peak, and the first sidelobe is 
31.5 dB down from the peak. Frequency responses of many 
different windows are given in Ref. 1 . 

The hardware for this module consists of an arithmetic unit 
for the window multiply, and a RAM coefficient memory 
which is loaded in from the control microprocessor during 
system setup. The window length is the same as the FFT 
length, and can be any power of two from 2 4 = 16 to 2 20 = 
1,048,576. 

E. FFT Module 

The FFT module transforms the time domain signal into 
the frequency domain by means of an FFT. The FFT of the 
input signal is: 

N - 1 

Y m (k) = y m ( < n ^ x V(-> 2vnk l N ')’ 


The window module applies a real, symmetric window to 
the fixed-point, complex input pairs for each spectrum. The 
operation is a simple real times complex multiply: 

y m (n) = w(n)x m (n) 


0<fc<7V-l (2) 

where {y m («)} is the output of the window module. The 
length of the FFT, N, can be any power of two from 2 4 = 
16 to 2 20 = 1,048,576. 


0<n<N- l 9 0<m (1) 

The subscript will be used to index successive spectra, or 
equivalently, segments of JV samples. Thusx m («) refers to the 
( mN + tt)th time sample. 

Since a window is a point-by-point multiplication in fre- 
quency, by the convolution theorem of the Discrete Fourier 
Transform (DFT) (Ref. 1 ; p. 59) the DFT of a windowed sig- 
nal is the convolution of the spectrum of the unwindowed sig- 
nal with the frequency response of the window. Thus the 
window (w(«)} shapes the frequency response of the FFT. If 
no window is applied, performing an FFT on a finite data seg- 
ment of length N is equivalent to using a rectangular window. 
The frequency response of the rectangular window is shown in 
Fig. 5. Since the FFT samples the spectrum at frequency points 
kF s /N , 0 < k < N - 1, the FFT of a frequency component 
depends on how close it is to a multiple of F s /N . The FFT for 
a frequency which is an exact multiple of F s /N is shown in 
Fig. 6(a). Figure 6(b) shows the FFT of a frequency exactly 
half way between two sample points. For Fig. 6(b) the peak 
magnitude is 3.9 dB less than for Fig. 6(a), and the first side- 
lobe at -13.5 dB is only 9.5 dB down from the peak. The fre- 
quency response can be improved by using a window like the 
Hanning window shown in Fig. 7. This window broadens the 
main lobe and suppresses the sidelobes. A frequency halfway 
between the FFT sample point would have a peak magnitude 


The FFT is implemented using the Radix-2, Decimation-In- 
Frequency (DIF), pipelined FFT algorithm. This algorithm is 
derived in detail in Ref. 1 (pp. 368-371). The Radix-2 form 
was chosen because it has the least complexity for addressing 
data and coefficients. The post-multiply butterfly of the DIF 
algorithm was preferred by the hardware designers. 

In the Radix-2, DIF algorithm the FFT is computed in 
M = log 2 iV stages. Each stage consists of a “butterfly” opera- 
tion on N/2 pairs of complex points. The butterfly, shown in 
Fig. 8, takes the sum and difference of the complex pairs and 
then multiplies the difference by the appropriate “twiddle” 
factor. The twiddle factors are complex roots of unity W£ k = 
exp(-j27rnk/N). At the zth stage, 1 < / <M, the pairs for each 
butterfly operation are the results from the previous stage taken 
2 m ~* apart, z i _ 1 (n) and z i _ 1 ( n + 2 M ~ l ), and the twiddle fac- 
tors are addressed by n 2 *~ l . The butterfly operation is: 

Z-(«) = {z_ 1 («) + z._ 1 (« + 2 m -')} 

0<n<N - 1 

z.(n + 2 m ~‘) = {z._ 1 (n)-z._ l (n+2 M - i )}W" 2 " 1 

Ki<M 



with 
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z 0 (») = y m (") 

and 

y m (U(n)) = Zm («) 

where U(n) is the bit reversal of n. The bit reversal is per- 
formed in the Unscrambler. 

Each FFT board, except the Final board, contains two but- 
terfly stages of a pipe-lined, Radix-2 FFT. The Final board 
contains four butterfly stages. Each stage consists of an arith- 
metic unit (AU) and a PROM coefFicient memory followed by 
a RAM delay memory with a cross switch. The cross switch 
is programmed to choose the correct data pairs for the next 
stage. The First six stages of the FFT are implemented using 
Fixed-point arithmetic and data. The Final fourteen stages use 
floating-point arithmetic and data. The last four stages are 
implemented on one board. There are no delay memories 
since only pipelined delays are used. In addition, the last two 
stages require no complex multiplies. The third card contains 
Response Bus connection for the first cage. The FFT module 
can be conFigured to produce any power-of-2, complex FFT 
from a 16-point up to a 1,048,576-point (2 20 ). 

F. FFT Unscrambler 

The FFT Unscrambler puts the complex, floating-point 
FFT data stream in natural order. The ordering involves bit 
reversing the addresses such that the input data with address: 

n = n Q + 2/ij + 2 2 n 2 + • • • + 2 *n fc 


of the normal input of a single complex channel. Two real 
channels can be transformed simultaneously if one channel is 
put into the real components and another channel into the 
imaginary components of the complex FFT input: 

x m ( n ) = a m ( n ) + j b m ( n )’ 0<n<N ~ l 

Since the spectrum of a real signal is conjugate symmetric and 
the spectrum of an imaginary signal is conjugate antisymmetric, 
the two channels can be separated by forming the conjugate 
symmetric and antisymmetric components: 

A mW =1 iY m (k) + Y*(N-k)}, Kk<N-l (6) 

and 

*-<*> - O'- W- 1 ': ("-«>. 1 

with 

A,<<» ■ W„,<P)> 

*„(°> - ■”0'-(<>» 

H. Power Accumulator 

The power accumulator module computes the power of 
each of the complex points output by the FFT and accumu- 
lates the power values into one of the channel accumulation 
memories. The output, P k (n), is 


■ + 2 


M —2 


+ 2 m ” 1 n 


M - 1 


becomes the output address: 


( 4 ) 


Lfc-l 

P k (n) = ^ |Y m (n)| 2 , k>0 (7) 

m=L(k- 1 ) 


U( n ) U M-\ + ^ n M- 2 + 2 U M- 3 + * ’ ’ 

+ 2 ^-i + -* + 2 M ’ 2 «i +2M “^o 

The bit reversal is performed by writing the data into a double- 
buffered memory in order n, and reading them out in order 
U(n). Two parallel output lines concurrently carry the upper 
and lower halves of the spectrum in sequential order. The 
module consists of two 1,048,576 by 44-bit memories and a 
crossbar switch. It also contains the control bus and response 
bus interfaces for the FFT cage. The board can unscramble 
any transform length from 16 to 1,048,576 = 2 20 . 

G. FFT Real-Adjust Stage 

The FFT Real-Adjust stage is used when the input is one or 
two real channels, a m ( n ) and b m («), 0 < n < N - 1 , instead 


where L is the length of the accumulation. The average power 
in each spectrum is computed and accumulated in place of 
the zero-frequency component. The two accumulation memo- 
ries, A and B , are controlled independently, and can be used 
to accumulate two different channels, or to switch the accu- 
mulators as in Dicke switching. Every valid spectrum entering 
the Power Accumulator module is identified as a type A or B 
by the frame synchronization indicator. The maximum accu- 
mulation length is 2 16 , and is controlled by frame trigger syn- 
chronization signals generated by the Input and Control 
module. 

The power is computed in floating-point arithmetic and 
then converted to Fixed-point in order to provide sufficient 
precision during the accumulation. The accumulations are 
performed with fixed-point arithmetic and then converted to 
floating-point before being output to the baseline module. The 
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module consists of two arithmetic units, one for the power 
calculation and one for the accumulation operation, two bar- 
rel shifters to fix the input and float the output, and a RAM 
memory for the 60-bit wide, 1 ,04 8, 5 76 -point accumulated 
spectra. The power accumulator board also provides the 
multi-bus connection for the signal processing cage. The input 
and output are 22-bit floating-point numbers. 

I. Baseline Module 

The baseline module removes the frequency-dependent 
system gain by multiplying each spectrum channel by the 
inverse of a baseline value. The floating-point baseline can be 
loaded in by the system controller during system setup, or 
computed by inverting a baseline formed from the input 
channels. The baseline is formed by applying an exponentially 
decaying update filter to the frequency components of the 
power accumulator. Components greater than a specified 
threshold value are not used to update the baseline. A local 
spectrum average is used instead. The baseline algorithm is; 

S k (n) = P^nyB^in) (8) 

(0 -a)B k j (») + <*/>* (n) if5 fc («)<r 

V") = 

(0 - a)B k ^(n) + aP k (n - 1) itS k {n)>T 

( 9 ) 

where P k (n) is a local average of the spectrum values formed 
by another exponentially updated filter: 

P k (n) = (1 -«?*(*- 1) = pP k (n) 9 i fS k (n)<T 

( 10 ) 

If the baselines spectrum value S k (n) is above the threshold, 
the spectrum average is not updated. Since there can be two 
distinct sequences of spectra from the Power Accumulator, 
there are two baseline memories to accommodate them. 

The inversion of the floating-point baseline is performed 
by table lookup on the mantissa values, and negation of the 
exponents. The baseline module consists of an arithmetic 
unit (AU) to implement the inverse baseline multiply and 
update filter, a floating-point table-lookup inverter, and 
RAM memories for the baseline. 

J. Spectrum Filter Module 

The Spectrum Filter module contains a five-coefficient 
Finite Impulse Response filter which filters each baselined 
frequency component across successive spectra. The spectrum 
filter can be a matched filter to any desired single-frequency 


time signature of duration less than or equal to five accumu- 
lation intervals. The example in Fig. 2 was for a source transi- 
ting an antenna beam. Another example is needed. The filter- 
ing operation is: 

1=0 

where the a h 0 < / < 4 are input parameters. To implement a 
filter of length less than 5, simply set the end coefficients to 
zero. 

The filtered output which passes a threshold test is sent to 
the Spectrum Processor via a high-speed data bus for additional 
processing. The output can also be sent to the Output proces- 
sor. A bit mask suppresses specified components so that they 
do not pass the threshold test. The mask is input from the 
control computer. The spectrum filtering operation requires an 
arithmetic unit and four 1,048,576 by 22-bit memories. 

K. Output Processor 

The Output Processor controls the amount and form of 
the spectrum analyzer output. A full buffer of data is col- 
lected and then sent to the system Response Buffer on the 
Executive board for transfer to the processing computer via a 
microprocessor bus. The output data is used for the spectrum 
displays and can also be used for further processing. The out- 
put data can be a snapshot of a full spectrum, or a selected 
window of data from successive spectra. The Output Proces- 
sor can divide a spectrum into sections and choose the £th 
value, select the peak value, or compute the average value for 
each section. The Output Processor consists of an arithmetic 
unit and a 1,048,576 by 50-bit buffer memory. It also con- 
tains the Control Bus and Response Bus connections for the 
signal processing cage. 


III. Scaling 

The 22-bit floating-point format represents numbers with 
exponents from -32 to 31, and mantissas from -1 to 1-2” 15 . 
Numbers between (-2~ 33 + 2" 47 ) and 2“ 33 will all be repre- 
sented as zero. Negative overflow occurs for numbers less 
than -2 31 , and positive overflow occurs for numbers greater 
than 2 31 - 2 16 . Scaling is used to keep the numbers computed 
in the spectrum analyzer within the dynamic range of the 
floating-point format. 

To determine the range of numbers the analyzer will 
encounter, we consider two different types of input signals, 
a pure sinusoid, and Gaussian white noise. 
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The samples of the complex sinusoid with amplitude A , 
initial phase 0, and frequency / are: 

x(n) = ^expO'0)exp(/27r/n/F) (12) 

where F s is the sampling frequency. The FFT of this signal, as 
defined in Eq. (2), using a rectangular window is: 


of the imaginary and real components, and accumulating L of 
these power values results in a chi-square distribution of 
channels with 2 L degrees of freedom: 


P(x) = — — x L 1 exp [-xN I (2a 2 )] 

2 l (o 2 /N) l r(L) 


(15) 


Y( v\ = A sinffA r flF, 

K) Nsmn(flF s -klN) 


(13) The expected value of this distribution is 2Lo 2 jN with 
variance 4 L(L + \)o 2 /N. 


with power A 2 at k/N - f/F s and less than ,4 2 elsewhere. If 
we accumulate over L spectra, the maximum power will be 
LA 2 . 

For complex Gaussian white noise, the real and imaginary 
components are independently, identically distributed Normal 
(0, a 2 ): 

p(x ) = -J== exp[-x 2 l(2a 2 )] (14) 

\ 2TT0 2 

The frequency bins of the FFT from Eq. (2) will be identically 
distributed Normal (0, o 2 /N). Taking the sum of the squares 


Since the spectrum analyzer input consists of 8-bit two’s 
complement numbers, the range for both A and a is 2~ 7 to 1 . 
As seen from the above discussion, the FFT output range is 
much larger than the input range, and the power of a sinusoidal 
signal in a frequency bin is approximately N times as large 
as the expected power of Gaussian white noise. In order to 
keep the accumulated output from overflowing the floating- 
point range, and at the same time keep the noise power from 
underflowing, we provide a scale factor in the form of an 
exponent bias applied at the input to the first floating-point 
FFT stage. The bias exponent, B , will be based on the length 
of the FFT, N , and the number of accumulations, L, in order 
to retain as much precision as possible while avoiding overflow. 
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Table 1. Spectrum analyzer modules 


Module 

Quantity 

IF Signal Input 

2 

Executive Board 

1 

Input and Timing 

2 

Window 

1 

Fixed-Point FFT 

3 

Floating-Point FFT 

5 

4-stage FFT 

1 

Real-Adjust Board 

1 

Unscrambler 

1 

Power Accumulator 

2 

Baseline 

2 

Spectrum Filter 

2 

Output Processor 

2 

Output Buffer 

1 

Interface Board 

1 

Power Supplies 

2 

Cages 

5 

Rack 

1 

Microprocessor System and Software 

1 




— CAGE 3 


CAGE 4 


CONTROL BUS 



T 
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2 
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Fig. 1. Spectrum analyzer system 
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This article describes a source detection strategy for the SETI All Sky Survey . The 
method is designed to detect continuous wave (or very narrowband) sources transiting 
an antenna beam. The short-time spectra of the received signal are accumulated, and 
candidate extraterrestrial sources are recognized by the presence of narrowband power 
exceeding a threshold function. The threshold function is derived using a Neyman- 
Pearson hypothesis test. 


I. Introduction 

The NASA program for the Search for Extraterrestrial 
Intelligence (SETI) is currently developing prototype signal 
processing hardware and software, search strategies, and 
observing procedures for an ambitious search to be conducted 
in the early 1990’s. The long range NASA SETI plan calls 
for an All Sky Survey covering the 1-10 GHz frequency range 
and a Targeted Search covering the 1-3 GHz frequency range. 
In the All Sky Survey, all 4 tt steradians of the celestial sphere 
will be surveyed with approximately uniform sensitivity for 
the presence of narrowband signals of extraterrestrial origin. 
In the Targeted Search, a thousand candidate sources will be 
observed, including nearby solar-type stars and interesting 
sources identified by the All Sky Survey. 

The JPL SETI team has the responsibility for designing, 
developing, and implementing the All Sky Survey. To detect 


ETI signals, which are assumed to be narrowband, we divide 
the input bandwidth into narrowband channels using a Fast 
Fourier Transform (FFT). The FFT output power in each 
channel is accumulated and convolved with a filter matched 
to the antenna beam shape. A thresholding operation is 
performed on the matched-filter output to locate channels 
with excess power. These events are stored for a confirmation 
test on the return scan. The processing up to and including 
the matched filter is performed in a high-speed digital spec- 
trum analyzer such as that described in Ref. 1. A digital 
computer system will detect ETI signals from the spectrum 
analyzer output. 

This report presents the current design for the signal detec- 
tion strategy. In the next section we describe the All Sky 
Survey. Section III describes the signal characteristics, and in 
Section IV we derive the performance characteristics for a 
Neyman-Pearson detection system applied to these signals. 
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II. The SETI All Sky Survey 

The characteristics of the All Sky Survey are shown in 
Table 1. The basic premise of the Sky Survey is that we do 
not know where to look. There are over a million solar-type 
stars within a thousand light years of the earth, and their 
density per unit steradian is approximately uniform. Since we 
also do not know how strong a signal might be, there is no 
preferred direction within this volume of stars. 

To satisfy the first three characteristics, the antenna beam 
must be swept across the sky at 20 to 50 times the sidereal 
rate. The sensitivity of the survey is thereby established 
(within an order of magnitude), and the class of signal types 
is restricted to Continuous Wave (CW) and narrowband signals 
with bandwidths from 10 to 30 Hz. 

The requirement of uniform sensitivity affects the signal 
detection strategy and the scan strategy. The specified varia- 
tion of sensitivity with frequency results from a compromise 
among frequency coverage, survey duration, and sensitivity. 
It assumes that the angular rate at which the main beam of 
the antenna is swept across the celestial sphere is independent 
of the survey frequency. Because the beam area is inversely 
proportional to frequency squared, the duration of the survey 
is approximately proportional to the square of the highest 
frequency observed. If it were required that the sensitivity 
be independent of frequency, the scan rate would increase 
with frequency, and the duration of the survey would then 
be proportional to the cube of the highest frequency observed 


Figure 1 is a schematic representation of one scan strategy 
which can satisfy these requirements using an alt-azimuth 
antenna. The pixels visible to the observatory are mapped by 
scanning the beam along lines of constant declination near 
transit. The maximum rate at which the antenna may be 
driven places an upper bound to the declination range for 
which this strategy may be employed and still yield a uni- 
formly sensitive survey, since the required azimuth rate for 
this strategy varies inversely with the cosine of the declination. 
A different scan strategy must be employed at higher declina- 
tions. In general, a pixel will be mapped using a boustro- 
phedonic scan pattern designed to optimize the system tem- 
perature by minimizing changes in elevation. A representative 
three-scan pattern is shown in the center of Fig. 1. 

Although we desire to minimize the time lost reversing 
the direction of motion, care must be taken to avoid exciting 
the normal modes of oscillation of the mechanical system. 
Antenna dynamics and servo control time constants deter- 
mine the duration of the turnaround period at the end of 
each scan. The scan length must not be so short that a large 
part of the time is wasted on the antenna turnaround. 


III. Signal Characteristics 

If the number of independent samples included in the 
accumulation is large, the limiting sensitivity to a CW source 
achieved by accumulating over time r as the antenna beam is 
swept through its position is: 


A survey of the sky to a uniform limiting flux at any given 
frequency requires that the main beam of the antenna be 
swept across the celestial sphere at a rate that varies inversely 
as the square of the system temperature. The scan strategy is 
therefore designed to minimize the system temperature and 
its fluctuations, caused, for example, by changing sidelobe 
pickup and sky temperature variations. It must also utilize 
the antenna time efficiently, minimizing the time spent 
accelerating and decelerating and the time lost waiting for 
mechanical oscillations to damp out. Since SETI will not be 
the sole user of the antenna, it is necessary to subdivide the 
celestial sphere into elements which can be observed over the 
course of one to four hours and which are easily incorporated 
into a complete sky map with minimum overlap. Finally, 
the scan strategy must satisfy the requirements of the signal 
detector for signal confirmation and RFI rejection. In order 
to satisfy these conflicting requirements, we choose a reason- 
able survey time and design our strategy to achieve maximum 
sensitivity and uniformity. As shown below, our strategy 
requires that the scans be of moderate length and that suc- 
cessive scans be adjacent to one another. 


$(r,r) = ^j 7 - W/m 2 (1) 

7 T7]D 2 1 p 

— f G(\p)d\p 

t 

where a is the signal to noise ratio (SNR) for detection, T is 
the system temperature (K), k is Boltzmann’s constant (Watt- 
sec/K), 77 is the aperture efficiency, D is the diameter of the 
circular equivalent aperture (meters), and b is the spectral 
resolution (Hz). The effective gain during the integration 
time is represented by the dimensionless function, G(\p), 
which is defined here to be unity when the source is on the 
beam axis. If the antenna beam tracks the source position 
rather than scanning through it, the integral becomes r and the 
limiting sensitivity decreases as 1 j\Jr. 


The time required to move the antenna beam through one 
half power beam width (HPBW) is approximately: 


70c 

vDco 


( 2 ) 
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(3a) 


in seconds where c is the speed of light (meter/sec), c o is rate 
in degrees/second at which the beam is swept across the sky 
(deg/sec), and v is the frequency at which the survey is being 
carried out (Hz). The length of time that the source will be 
in the beam is approximately equal to 2 t B , but the effective 
gain will vary greatly over that time interval. 

Figure 2(a) shows the expected response within a frequency 
bin as the antenna beam is swept across the source position. 
For simplicity only a one dimensional slice of the circularly 
symmetric beam is shown. If the frequency response is mea- 
sured as a source transits the beam, then the matched-filter 
detector would convolve the response with the beam shape 
shown. The ideal matched-filter would be many HPBWs long 
in order to use all the power from the source. It is desirable 
to find a practical filter length on the order of a HPBW. Fig- 
ure 2(b) shows the SNR loss versus filter length in fractions 
of a HPBW. For lengths greater than 0.9 HPBW, the loss is 
less than 0.25 dB. 

To keep the processing hardware cost-affordable, we 
accumulate spectra until there are only 3 to 5 spectra per 
HPBW. Figure 3(a) illustrates this coarser resolution and 
shows that the best SNR is realized when a source transits 
the center of the beam at the center of an accumulation 
interval. The worst case is when the maximum occurs at the 
transition between two accumulations. The uneven response 
due to this difference in source position is called scalloping. 
Figure 3(b) shows the SNR loss between the worst case and 
the best case for filter lengths of 1 HPBW and 0.6 HPBW. In 
both cases scalloping decreases as the number of accumula- 
tions increases. 

IV. The Signal Detection Strategy 

The purpose of this section is to provide the background 
and theoretical basis for SETI sky survey signal detector 
performance evaluations. The problem is formulated as a 
classical binary decision problem of detecting a signal with 
random parameters in noise (Refs. 2, 3). Our treatment will 
rely, where applicable, on results to be found in the radar 
signal detection literature (Refs. 4, 5). 

Figure 4 illustrates the basic front-end processing which is 
to be performed on the received signal. The ETI signal is 
assumed to be narrowband Continuous Wave (CW) of the 
form: 

s (t) = A cos (2nf s t + 0) (3) 


r(t) = A cos (2irf s t + 0), {#,} 

r(t) = «0), {H q } 

where m (r) is a zero-mean Gaussian noise process whose vari- 
ance, a£, j s determined by the effective system temperature. 
Denoting by x ; (4) the /th sample of the ath frequency bin, 
the accumulator output is given by: 

The probability density function (PDF) of the test statistic 
f under the null hypothesis {// 0 } is the gamma distribution 
with 2N degrees of freedom and E {£} = 2N, oj = ANo 
The PDF of f under the alternative hypothesis {//j} is the 
non-central chi-square distribution. The parameters of the 
PDF need to be explicitly related to the SETI observation 
parameters. In the receiver input with signal present, Eq. (3), 
if A were constant, then the f . would have the form: 

<?' (A+x'f 
1 

where the x { are identically distributed Gaussian random 
variables with zero mean and variance o 2 Q (the system noise). 
However, under the conditions of the survey, the antenna 
scans at a relatively rapid rate and thus during the time 
required to accumulate N samples ( T = Nt , where r is the 
analyzer sample time), the received signal is modulated by the 
antenna beam pattern. We thus rewrite Eq. (3) as: 

r{t) = A (t) cos (2irf s t + 0) + n(t), (5) 

and note that the actual form of the is now: 

s' 

1 = 1 

Thus, from the results of Whalen (Ref. 2), the expression 
for p Q ( •) is the chi-square distribution with 2 N degrees of 
freedom: 


and the spectrum analyzer is assumed to have a resolution of 
20 Hz. The detection system is designed to test for the two 
possibilities: 


p 0 cn = 


(olf 2 n r(A0 




-1 


-r/( 2 trg) 


( 6 ) 
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and for^Ois: 


Note that the A { have units of energy, so that the signal-to* 
noise ratio (SNR) for a single sample observation is: 


P,(f) = (yV V exp|^(f + X)/2a^/ v _j (VxF/a 2 ) 

° (7) 


with 2N degrees of freedom, where: 


X = 



A 


2 

i 


SNR f = 


A t 


( 12 ) 


If we re-examine the expression for Eq. (4), we see that the 
effect of antenna scanning is to produce weighted accumula- 
tion of individual samples, where the weight function, w., is 
just: 


In Eq. (7), I N ( •) is the modified Bessel Function of the first 
kind and order N. These distributions are discussed in detail 
in Refs. 2 and 6. 

We are now in a position to examine explicitly the effects 
of antenna scanning on p (•). The antenna scan rate is go rad/ 
sec, and the main lobe half-power beam width (HPBW) is 
D rad. The scan rate in HPBWs/sec is: 

v = co ID, (8) 

If S Q represents the ETI signal flux at the surface of the earth 
in W/m 2 , then 


w. = exp {-[^(/ f -r 0 ) + (?°) 2 /n 2 ]} (13) 

From the above discussion, and our expression for w., it 
is apparent that for fixed (r, D, TV) increasing the antenna 
scan rate above some value, co max , reduces the accumulator 
performance to no better than single sample detection. In 
fact, an upper limit on scan rate may be set by choosing some 
minimum weight for the Nth sample as the antenna scans 
through a source. To illustrate the point, consider the case 
where the source position is (£° , £°), TV is odd, and the center 
sample is taken with the source on beam-axis, i.e., n = (N + l)/2 
at £ . The weight function is rewritten with time in units of 
nr as: 


A w = ("T" eS o) ex P (" \ l" 2 V " f 0 ) 2 + (f 2 ) 2 m 2 ]) 

(9) 

where D is the antenna diameter in meters, and e is the 
antenna efficiency. A Gaussian main lobe shape has been 
assumed, and the coordinate system chosen, (£j, £ 2 ), is 
centered on the moving bore-sight axis of the antenna, and 
£ 2 ) denotes the actual source position. Thus, our expres- 
sion for the A r which determines the non-central parameter, X, 
is: 




r 



exp (- [ v 2 (t- t Q ) 2 + (f 2 ) 2 ID. 2 ] )dt 

( 10 ) 


This expression is rather cumbersome, so we make the sim- 
plifying assumption that r « 1 /v y i.e., point-wise sampling, 
and rewrite Eq. (10) as: 


u> rt = exp [- v 2 t 2 (n - (N + l)/2) 2 ] , n = 1, 2, • • ■ , N 

(14) 

Letting 0 denote the minimum desired weight, from Eq. (14) 
we find 


“max =-gf [In (1/0)1 1/2 (15) 


or 


m t$7N < 16 > 

where / 0 is the system operating frequency in GHz. Thus, for 
D = 34 meters, / 0 = 1 GHz, r = 50 ms, and N = 8, if we require 
0 = 0.5, then co max = 10 mrad/sec. On the other hand, at the 
upper end of the SETI survey frequency range, f Q = 10 GHz, 
we have oo max = 1 .0 mrad/sec which is significantly less than 
scan rate capabilities of the antenna system. Since r is fixed 
and to max is only very weakly dependent on 0, the dominat- 
ing factor is our choice of N. For the time being we will 
assume that go and N may be suitably chosen so as to yield 
approximately uniform accumulator weighting; thus: 


A 2 =^eS 
A i 4 


exp (- [ v 2 (t- 


f 0 ) 2 +(?2) 2 /n 2 ]) 


(ID 


A 2 


l tD 2 

4 


eS n 


(17) 
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and the non-central parameter appropriate for p^*), Eq. (7) 
is given by: 

X = 2NA 2 (18) 

We conclude our discussion of the statistics of £. by casting 
the results obtained above in a form more amenable to compu- 
tations described in Section IV. To accomplish this we intro- 
duce the “normalized” test statistics 



where the random variable (x'/ ct q ) is now zero-mean Gaussian 
with unit variance. The resulting PDFs under and // are 
now given by (Ref. 2) 

PM) ~ ex P ("«/2) (21) 

0 2 n r(N) 

with 2N degrees of freedom, E {q} = 2N, Var {<?} = 47V; and 


A. Case I 

Referring to Fig. 6 , we see that detection is carried out by 
applying a single threshold test to the individual qff^) This 
case corresponds most closely to the classical radar detection 
problem with noncoherent integration (Refs. 4, 5, 8 ). Since 
a priori probabilities cannot be realistically assigned for 
H q and H l , we choose to use the Neyman-Pearson criterion 
for choosing our decision threshold. With the usual notation 
we define the probability of false alarm as: 

oo 

P FA = P(Z) 1 |i/ 0 )= jf p 0 (q)dq (23) 

or 

p fa = \-f o(r?) (24) 

where E Q (y; q) is the cumulative distribution function describ- 
ing Hq , evaluated for q = 7 ; thus 

00 

F 0 (y; q) = J P 0 (q) dq, q>0 (25) 

This later form is more useful for numerical computations 
(Refs. 4, 8 , 9). Similarly the probability of detection is: 


Pi (q) 



(N-m 

exp [- (X + <7)/ 2] r N _ , (Vx^ ), 


X = 



( 22 ) 


P D •P{D l \H l ) 



P x (q)dq 


or, as above 


P D = 1 -FJrq) 


(26) 


(27) 


with 2 TV degrees of freedom, E {q} = X + 27V, Var {< 7 } = 4 
(X + N). Notice that, unlike the strictly Gaussian assumption 
sometimes used in detection problems, the presence of signal 
affects both the mean and variance of p x (• ). 


Using the Neyman-Pearson criterion our threshold value, 
7 , is found from the required false alarm rate. Thus, we solve 

p 0 (q)dq=l-p (28) 



For the purpose of performance prediction calculations we 
assume the ETI signal bandwidth to be much less than an 
analyzer bin-width, and that, if present, the signal is centered 
in a bin. These assumptions correspond roughly to Swirling’s 
Case I model (Ref. 5). We will not discuss the effects of 
moving the signal within a bin in this article. We wish to 
examine the detection performance of several processing 
scenarios which cover a side range of cost and implementation 
complexity. The cases in this work are summarized in Fig. 5, 
and illustrated with data flow diagrams in Figs. 6-9. 


where 0 is the desired false alarm rate. 

B. Case II 

Here we return to a discussion of the effects of antenna 
beam and shape and scan rate on our ability to detect an ETI 
source. A preliminary discussion of these effects for the case 
N = 0 (no accumulation) is described in Lockshin and Olsen 
(Ref. 10). The discussion leading up to Eq. (17) assumed that 
a scan strategy could be devised so that Nt« 1/v. Thus, the 
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accumulator output gives us a sky sample every Nt seconds, 
or spatial sampling at “points” separated by Ntco radians. We 
will call this spacing the “intra-scan” separation. 

5 = Nrto radians (29) 

Intuitively it is clear that, given a finite £2, and assuming a 
uniform PDF for the spatial distribution of ETI sources, the 
probability of detection should be a monotonically decreasing 
function of 5 using the test statistic (or equivalently, q.). 
Looked at from another viewpoint, for a given choice of 5, 
the scanning operation cannot be accomplished at uniform 
sensitivity, an effect referred to as scalloping in Ref. 10. 
This means that for a source located between f . and , the 
probability of detection will be less than if the source were 
at either or . 

In order to provide more uniform scan sensitivity, the 
accumulator output, after baseline correction, is passed 
through a convolutional filter as shown in Fig. 7. We thus 
have a new test statistic given by: 


M - 1 



(30) 


where the filter weights, a m , are chosen to optimize P D over 
the sky area covered by the M sample points. Due to the 
weighted sum in Eq. (30) the PDFs under H Q and H 1 are no 
longer simply chi-square or non-central chi-square. Writing 
the test statistic as: 


and 


C t (J cj;u) = exp [ - 


NMA ‘ 
2 al 


x ex p( 2 ^ 


M 


xn 


NA 2 (Tq/2 ' 
[1 co] 

1 


U 0-j2a t a 2 0 uf 


(33) 


As will be seen in Section IV it is not necessary to invert 
Eqs. (32) and (33) to obtain explicit expressions for P 0 (u) 
and p 2 (w). A discussion of weighted signal summation may be 
found in Di Franco and Rubin (Ref. 7). Since the test statistic 
u is composed of M samples covering a particular area of the 
sky, we actually need to compute: 


P t («) = Jjp 1 (ul$,%)PG 0 1 )P(%)d%d$ 

r (34) 

where (£°, £°) describes the source position. Here, {p(£°) 
p(£!|)} * s t ^ ie j°* nt PDF describing the spatial distribution of 
sources, and is assumed to be uniform. The dependence of 
p(u) on (£°, £°) enters through the parameter A , which 
depends on intrascan separation, 5, HPBW, and relative source 
position. The required detection probabilities can be com- 
puted without an explicit evaluation of Eq. (34). 


M 

« a Ai ( 3i ) 

1=1 

a single component, u. = a.q., has a PDF given by: 

p (u P = i^i 


C. Case III 

Further improvements in system performance can be 
obtained by combining observations from adjacent scan lines, 
i.e., “inter-scan line” signal combination. Case III represents 
an implementation of inter-scan line combination with a 
means for drastically reducing the amount of data storage 
required. Data decimation is achieved by “pre-thresholding” 
the convolutional filter output so as to allow only a certain 
percentage (on average) of the data to pass through for fur- 
ther processing. The pre-threshold level is set according to: 


Using the Fourier transform scaling property and the known 
characteristic functions for P o 0?) and P x (q)y the characteristic 
functions for P 0 (w) and p l ( u ) are found to be: 





p 0 (u)du = n 


(35) 


C 0 0'w.m) 


n 

»= i 


i 

(1 -j2a.cof 


where 77 is the fraction of data allowed to pass threshold. By 
introducing inter-scan signal combination, we now have a 
test statistic which is bivariate, and in which each of the 
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marginal distributions is a thresholded version of p Q (y), and 
p x (y). If we denote the test statistic after prethresholding by 


u\ then (Ref. 1 1), 


/>,(«)> 

U> 7 P 

P,(«') = <P / (7 p )S(M-7p). 

u ~7 p 

(o. 

u< 7 p 


variable (Refs. 2, 12). Specifically, the null hypothesis is 
simple, while the alternative hypothesis is composite, being 
conditioned on the ETI source location parameters. Fur- 
thermore, since we are now dealing with a bivariate distribu- 
tion, the decision regions, R Q and R , are no longer divided 
by a single threshold value, but in fact by a family of such 
values which define a decision curve on the ( u ' , n' 2 )-plane. 
The situation for a simple case is shown in Fig. 12, where 
the Neyman-Pearson curve is taken to be a quarter-circle; 
the region excluded by prethresholding is shaded. 


The behavior of this thresholding operation is illustrated in 
Fig. 10. As noted in Fig. 8, our test statistic, w, is a two- 
dimensional vector whose components are {u k , u k + K }. For 
notational convenience we will simply write u = (u\ y u 2 ) and 
remember that u\ and u r 2 refer to sample observations from 
adjacent scan lines. Now in order to determine the average 
system response to an ETI signal located somewhere in the 
area defined by the two vertically adjacent beam patterns, 
we assume a uniform spatial distribution of sources all of the 
same strength. Note that this result depends on vertical scan 
separation and beam profile, but not on scan rate. 

If we denote by and £ 2 the horizontal and vertical 
coordinates describing the location of an ETI source (see 
Fig. 1 1), then the joint PDF describing u is given by: 

r 

XP(^)PQ 2 )d^d^ 2 (37) 

where the integration is carried out over the region T, as 
shown in Fig. 11. Since we are assuming uniform spatial 
distribution of source locations, 

p(S,)p(S 2 ) = i/r 

The explicit dependance of Pj («•!£, , £ 2 ), / = 1, 2, on , £ 2 ) 
enters through the system response dependence on beam 
profile in a manner analogous to that shown by Eq. (7). Again 
assuming a Gaussian beam profile, the expression for A (£ , 
£ 2 ) is given by: 

A (Ma) = ^ e5 o ex P K*i -S?) 2 « 2 -^) 2 l| 

(38) 

The situation described above will be recognized as a prob- 
lem in composite hypothesis testing for a bivariate random 


D. Case IV 

For analysis purposes this case is identical to Case III 
except that we remove the prethresholding operation and 
allow the data to continue on to be combinatorially pro- 
cessed. A practical implementation of this case would of 
course require a very large amount of high-speed bulk storage 
and significantly increase processor speed requirements. 

As can be seen from the above discussions, we have assumed 
a signal processing implementation which defers RFI and 
“natural source” identification operations to the very last 
processing step. This is not only useful for analysis purposes, 
but is in fact probably the only practical manner in which 
to implement a sky survey processing strategy. As a final note, 
we point out that all of our analyses assume that the “noise” 
is stationary, i.e., position independent. If this turns out to 
be a poor assumption, then the detection performance must 
be re-evaluated to incorporate adaptive threshold methods 
(Refs. 13, 18). The following section is devoted to describing 
in some detail the actual implementation of performance 
calculations carried out based on the problem formulation 
described in this section. 

V. Performance Analysis Calculations 

In this section we wish to describe the methods used to 
carry out the required computations based on the discussion 
of Section III. The objective of these calculations is to produce 
a set of receiver operating characteristic (ROC) curves for 
each of the processing Cases (I-IV). These ROC curves will 
then be used to choose the signal processing strategy that 
yields the best performance/cost ratio. As has been pointed 
out in the literature (Refs. 8, 9, 14), numerical implementa- 
tion of detection probability analyses encounters several 
practical difficulties. Some of these difficulties will be dis- 
cussed before we proceed to describe the computational 
implementations actually used. 

For our purposes, there are basically two computational 
issues to be addressed: (1) the use of Gaussian versus true 
PDFs; and (2) the choice of a numerical computation proce- 
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dure for the required probabilities. At first sight one might 
suspect, from the Central Limit Theorem, that Gaussian PDFs 
would provide an adequate approximation for our cases. 
However, we need to keep in mind that because of the small 
false alarm rate requirements (<10 -8 ), we are working very 
far. out on the tails of distributions. Due to the relatively small 
number of samples involved (<50) one cannot expect the 
Gaussian to provide a very good approximation except near 
the “core” of the distribution. When using Gaussians to 
model the problem, we will use the means and variances 
computed from the actual non-central chi-square distributions 
as the Gaussian parameters. Regardless of the actual PDFs 
used, the choice of a numerical evaluation algorithm is critical 
in determining both solution accuracy, precision requirements, 
and computational time. Direct numerical integration of the 
PDFs invariably requires the use of extended computation 
precision and dynamic range and can result in excessively 
long CPU times (Refs. 8, 9) when one demands small false 
alarm rates. 

We shall begin our discussion by setting out those elements 
of the computation that are common to all four cases. A 
general computation flow diagram is shown in Fig. 13. As 
pointed out in Section III, all variables are normalized by 
0 ^ so that the system noise PDF is zero-mean Gaussian with 
unit variance. The quantity a * is determined solely by the 
effective system temperature and thus represents the noise 
energy at the receiver front-end. The SNRs used in computing 
the ROC curves are referred to the receiver front-end, and 
are defined as 

S = SNR = 771)2 eS o , (39) 


al = kT It 

0 s 


P FA = 1-F n (y;q)=l- / p n (q)dq 


-L 


r 7 

P D = 1 -^(7/^=1- / P x iM)dq 


(41) 

(42) 


and that the moment generating function (MGF) for p(x) 
is defined by 


H(p) = E {e- v *} = 



x>0 


(43) 


we may write a general expression for the required quantities 
using the inverse Laplace transform, 

1 -F( y;x) = L~ l {iT 1 [1 - m(^)] > 


efi°° 



[1 -p(y)] 


vx dv 

e x — — : 
277J 


(44) 


where the contour of integration is parallel to the imaginary 
axis and lies to the right of all poles in the integrand (Ref. 16). 
Helstrom’s approach uses a saddlepoint integration (Ref. 17) 
technique to obtain an efficient approximation to the contour 
integral in Eq. (44). Taking the contour to the left of the 
origin, but still to the right of all singularities in the integrand, 
Eq. (44) may be expressed as 


l -F(y;x) 



-it 1 n(p)e? x 


d v 
2m ' 


c < 0 


(45) 


where k is Boltzmann’s constant, and T is the system tempera- 
ture in Kelvin. In terms of the system parameters then: 


t tD 2 €tS q 
S = 4kT 

S 


(40) 


Using the fact that the integral in Eq. (45) is convex over 
(-00 < v < 0) the contour is placed so as to pass through 
c = y Q , i.e., v = v Q + iy (-«> < y < cc ), the point v Q being the 
saddlepoint. Writing 


v~ l p(y)e vx = (46) 


In the numerical implementation of calculations described in 
this section all expressions for P p and ? D are parameterized 
in terms of 5. 

One of the more elegant and powerful methods for efficient 
numerical evaluation of detection probabilities has been 
described by Helstrom (Refs. 14, 15). Recalling the expres- 
sions for /L . and/L from Section III, 

FA D * 


and expanding <£>(y) as a Taylor series about v Qi 

*00 = *(* o ) + y *> o ) 0'-*' o ) 2 + -- 

+ jr* (fc) ^-^ 0 ) k + --- (47) 
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the expression for [1 -F( 7 ;x)] becomes 
1 - F(y;x) = - if " 1 [ 2 w $"(« f 0 )]- 1 / 2 
X J u(i' 0 )e l ’o 7 (l+ J R), 


Denoting by p A (X | X) the PDF of X which describes the 
fluctuation model, the unconditional MGF is obtained from 


p(y I X) (X | X) c? X (53) 


«\,<0 (48) 


n(v) = 


L 


where R is the residual term given by Helstrom (Ref. 14). 
The saddlepoint is found simply by solving 

$» = ln [m O')] + 7 - — = o (49) 

numerically and noting that <J>(y) possesses only a single 
minimum ( v = v Q ) on the interval (-°° < v < 0). As Helstrom 
points out, for \E{q} - y | » o qi the residual term may be 
neglected and we shall use the zero-order approximation, 


With suitable change of variable, Eq. (53) is seen to be the 
Laplace transform of P K (*) and thus the unconditional MGF is 

MOO = (1 + »)~ v V x K(1 + »>)] (54) 

where / j x [*] is the MGF of the distribution describing our 
fluctuation model. Therefore, given a suitable fluctuation 
model which yields / u x [•] in analytic form, we may utilize the 
saddlepoint method to compute approximate detection 
probabilities for Cases II-IV. 


1 - F(y; x ) = - .r 1 [2n*> 0 )] ~ 1 ' 2 K%) e v °\ v 0 <0 

(50) 

The threshold, 7 , for a given choice of P is determined by 
an iterative solution of Eq. (50). 


Recalling the discussion and assumptions leading up to 
Eq. (17) in Section III, our Case II appears to formally corre- 
spond to the Swerling model I. In practice the situation 
actually lies somewhere between Swerling I and II. For sim- 
plicity we take our fluctuation model PDF to be (Ref. 5) 


The treatment of Case II and Cases III and IV requires 
evaluation of conditional probabilities. As can be seen from 
Eqs. ( 21 ) and (36), direct evaluation of the integrals involved 
is quite tedius and such an approach would not allow us to 
take advantage of Helstrom’s approximation technique. We 
therefore propose to treat these cases in the framework of a 
fluctuating target model (Ref. 5). The “fluctuation” is being 
induced by the antenna scan parameters and the assumption 
of a uniform spatial distribution for the probability of finding 
the source at a particular location within the area covered. 
Another view of Eqs. (31) and (37) is that the source position 
(£° , I®) results in a conditioning of p r ( m ) on X, the non-central 
parameter. 

Utilizing the above interpretation of the conditional prob- 
abilities encountered in Cases II-IV, we rewrite Eq. (43) as 

ju(HX)= f p l {q)e~ vq dq (51) 

Jo 


P x (X IX) exp(-X/X) (55) 

where X is computed by averaging the antenna response over 
the area covered by our M-point convolution of Eq. (28). 
Note that this averaging process includes the convolutional 
weights for each of the M samples. Cases III and IV are treated 
in the same way, the obvious extension to bivariate 
distributions. 

Finally we note that the MGF describing the test statistics 
used in Cases II-IV, can be derived in a manner similar to that 
used in finding the characteristic functions, Eqs. (32) and (33). 
Thus, for Case II the MGF’s under {H Q } and {/^l are given 
by 

M 

( 56 ) 

i=i 

and 


where P x (q) is our non-central chi-square PDF with N degrees MjOO = ex P 

of freedom and non-central parameter X. Recall that X is in 
fact the total signal-to-noise ratio at the output of the con- 
volutional filter. For the given PDF, Eq. (51) yields (Ref. 14) where> a$ before> the denote the convolutiona i fii ter weights. 

Here it is most convenient to use the cumulant generating 
p(y | X) = (1 + v)~ N exp [- \vj{\ + v)] (52) function, h(v) = ln ju(i>) and we then have 


M 

-£ 


a. \v 


Lu (1 + a. v) 
/= 1 1 


M 


f|d +a i v T N ( 5? ) 


1=1 
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M 

y*o = -A r 2 ln ( 1+a ^) ( 58 > 

i= 1 
and 

a. Xy _M_ 

^ W= -E(iT^)'''5 ln(1 *“<‘ ,) (59) 


Results of our performance calculations for the Gaussian 
model are shown in Fig. 14 and 15, for P pA of 10“ 12 and 


10" 8 respectively. For an assumed antenna temperature of 
25 K, an SNR ratio of 1 is equivalent to a received flux of 
approximately 2 X 1(T 23 W/m 2 at the antenna. The relative 
performance of the four cases studied is easily seen from these 
Receiver Operating Characteristic (ROC), curves. The largest 
increase in performance comes in going from Case I to Case II, 
where we add intra-scan combination processing. As is to be 
expected, there is little difference in performance between 
Cases III and IV; both cases yielded a performance increase 
of about a factor of two over that for Case II. A similar set 
of ROC calculations is currently being carried out using the 
actual chi-square distributions which describe the problem 
and will be reported in a later paper. 
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Table 1. Characteristics of the All Sky Survey 
(for a 34-m parabolic antenna) 


Spatial Coverage 
Frequency Coverage 
Duration of Survey 
Dwell Time on Source 
Frequency Resolution 
Sensitivity 

Spatial Uniformity 
Variation with Frequency 

Polarization 
Signal Type 


47r steradians 

1-10 GHz and higher spot bands 
5-10 years 
0.5-10 seconds 
10-30 Hz 

~10“ 23 Watts/meter 2 
12% peak-to-peak 

Simultaneous Dual Circular 
Continuous Wave (CW) 



RESPONSE AND WEIGHTING FUNCTION 



0 4 8 12 16 20 24 


RIGHT ASCENSION, hrs 


Fig. 1. Schematic representation of sky pixelation 
and scan strategy 




Fig. 2. Antenna scan effects: (a) the expected response within a frequency bin as the antenna 
beam is swept across a source; (b) the SNR loss as a function of filter length, X Q , in HPBWs 
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Fig. 3. Scalloping effects: (a) Schematic representation of the source of scalloping; 

(b) variation of SNR loss 



t (TIME) 



Zj (fa) 


1/4HPBW- 
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CASE 1: APPLY THRESHOLD DETECTION (NEYMAN -PEARSON) DIRECTLY 

TO BASELINE CORRECTED DATA; DO NOT USE INTRA- OR 
INTER-SCAN LINE COMBINATIONS 

CASE II: APPLY FOUR-POINT CONVOLUTIONAL FILTER TO SUCCESSIVE 
SAMPLES OF BASELINE CORRECTED DATA PRIOR TO APPLYING 
THRESHOLD DETECTION; ACHIEVES INTRA-SCAN LINE 
COMBINATION TO REDUCE SCALLOPING 

CASE III: EXTENDS CASE II TO ACHIEVE INTER-SCAN LINE COMBINATION, 
BUT APPLIES "PRE-THRESHOLDING" TO REDUCE DATA RATES 

CASE IV: RETAINS ALL ACQUIRED DATA NECESSARY TO ACHIEVE 
INTER-SCAN LINE COMBINATION PROCESSING 


Fig. 5. Signal processing scenarios 


Fig. 4. Front-end signal processing 
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Fig. 6. Signal processing, Case I 



Fig. 7. Signal processing, Case II 
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Fig. 8. Signal processing, Case III 
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Fig. 9. Signal processing, Case IV 
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This paper finds a rigorous asymptotic expression for the number of stable points of 
an infinite-range spin glass with independently identically distributed (i.i.d.) zero-mean 
gaussian exchange interactions. The result also applies to the number of stable points of a 
Hopfield Memory (a kind of associative memory) when the memory connections are i.i.d. 
zero-mean gaussians . The result is that the number of stable points is asymptotic to a 
constant slightly larger than 1 times 2 to a power slightly larger than n/4 , where n is the 
number of spins in the glass , or the length of the n-tuples to be remembered by the 
memory . The answer is easily derived using simple asymptotic techniques from an exact 
expression for the probability that an arbitrary ±1 n-tuple of spins is a fixed point . This 
expression is obtained from the fact that any distribution of joint zero-mean gaussians of 
given covariances is specified solely by these covariances. This is a far shorter derivation 
of the result than those existing. 


I. Introduction 

A spin glass (Ref. 1) can be identified with « -tuples of ±l’s, 
called spins o it 1 < / < n. Spins / and j(i=£j) interact via an 
exchange interaction symmetric matrix / = (7 /; ). Spin i “influ- 
ences” spin / via J ij 9 and j influences / likewise via J^ - Jy\ 
Jh = 0, 1 </</!. This means that, in the absence of other 
interactions, spin value o t changes to (or remains equal to) the 
value 



where the Sgn of a nonzero real number is its sign. We ignore 
the possibility that the sum in Eq. (1) is 0, for this event will 
have probability 0 in our model, where the J if - , /#/' , are inde- 
pendent identically distributed (i.i.d.), zero-mean gaussian, 
n(n - l)/2 in number. Thus o\ = ±1 accordingly as 2y =1 
JyOj is positive or negative. An rt-tuple of ±l’s, 

a = (a, ,o 2 ,--,o n ) 

is then a fixed point of the spin glass specified by the n X n 
symmetric matrix 

j - cy 
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provided 


o=o 


ie., 


In Eq. (4), oy/Sgna. = 1, 1 </ <«, and a / Sgn(a f )= 1. So 
Eq. (4) can be written 


Sgn 


(^2 / » sgn ( g -) s s n (°/) 


= !,!</<« 


(5) 


a! = a., 1 


(2) This is Eq. (3) with all o,. = +1 and Jy replaced by the n(n - l)/2 
random variables 


We ask, if the / /; - , i =£ /, are zero-mean i.i.d. gaussian (of posi- 
tive variance), what is the expected number of fixed points in 
Eq. (2)? 

Another formulation is to find the number of stable points 
of the Hopfield Memory (Ref. 2). In this, n-tuples o of ±l’s are 
input to an electronic device that connects each input to each 
other input via a conductance J g , where Jy = J j( , and all J H are 
zero. The n resulting voltages 

Ev, 


are each hard-limited to become the new o h - tuple, but again 
the changes occur at random rather than at synchronous times. 
See Ref. 3 for further details on the Hopfield Memory and its 
potential capacity as an associative or content-addressable 
memory in processing systems. 

From Eqs. (1) and (2), a is a fixed point if and only if 



This is also the -fixed point formula if all components change 
at once; the difference between the two concepts of fixed 
points is not relevant in what follows. 


J (j Sgn (a,) Sgn(a.) 

identically distributed with the Jy . 

The expected number of fixed points F n is then the prob- 
ability that the all l’s n-tuple is fixed, times the number of 
rt -tuples 2 n : 


F „ = 2 n J (j >0,1 <j<nj (6) 

Here we recall that the J t j = Jj t are n(n - l)/2 independent 
zero-mean gaussians of the same positive variance, which we 
take as 1 \J H = 0, 1 < / < n. 


III. Covariances 

What is the Covariance Matrix of two row sums of/, 

n 

x. = V 1 /.. 

i / j ij 
7=1 


and 


-jy„ * 


II. Reduction to a Positivity Condition 

We claim that the probability that a be a fixed point is the 
same for all o. This is because all the probabilities are equal to 
the one for a = (1 , 1 , • ■ • , 1). Merely replace Jy by Jy Sgn^) • 
Sgn(ay) so that Eq. (3) can be rewritten 

Sgn^^ t J..Sgn(a.)Sgn(a.) ^_j/sgn(a.)j = o. . 

(4) 


The means are 0, because each/ i; - has mean 0. The variances 
(k = i) are 

E{x^=n - 1 ( 7 ) 

because there are n - 1 independent random variables being 
added, each of variance 1 (recall J H = 0, all /). 

What is Cov(^, X k ), i =£ kl We claim that any two rows of 
the symmetric matrix / of exchange interactions has exactly 
one /-random variable in common, so that the rest are inde- 
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( 11 ) 


pendent. If we write the J xy always with x < y , row i (with the 
0 being in position i) is 


00 


, , . 0 /. . , 

1 1 2i i-l,r 1,1+1 



while row k is 


(J\k^2k ' ' '^fr-l,fr Q^k'k + l ' * *^fc«) 

We can let i<k without loss of generality. Then the only 
random variable in common between the two rows is J % , 
by inspection. So 


the cross-terms \fn -2 F( Y i Y 0 ) vanishing. Thus 
F(S 2 ) = n-1, Ki<n 

Likewise, 

£(5^) = 1,1 <i,k<nj=tk (12) 

From Eqs. (7) and (8), the n gaussian random variables S i have 
the same covariance matrix as the n guassian random variables 
and so we may use them instead of the X t to calculate F n 
in Eq. (9). This we do in the next section. 


Co\(X . , X k ) = E(X,X k ) = 1 J*k (8) 

This is because the cross terms 

= *iW = E( W = 0 

in every other case, because they involve mean-0 independent 
random variables. 

IV. Equivalent Gaussians 

Any n zero-mean gaussians of the same variances (Eq. (7)) 
and covariances (Eq. (8)) will do just as well (Ref. 4, Sec. 9.3) 
in order to find the probability 

P n = pr(X.>0,l<i<n) 


V. Exact Answer 

From Eq. (9), we want 

F = 2 n pr(S i >0, Ki<n) = 2 n p n (13) 

From Eq. (10), this can be written (for n > 2) as 


F = 2 n pr(Y i >Y 0 l^/^2 f l<i<n) (14) 

Since the n+ 1 Yf s are jointly independent, the n random 
variables Y x , Y 2 , • ■ • , Y n are conditionally independent given 
that Y 0 =y, So 

pr{Y x > YjsfT^ 2, Ki<n\Y 0 =y) = [Q(y/y/^2 )] " 

(15) 


This, from Eq. (6), is 2"" times the desired answer F n for the 
expected number of fixed points of the random gaussian spin 
glass: 

F n = 2 n pr(X t > 0, 1 </<«) = 2 n p n (9) 

Here is another way of getting zero-mean gaussians of the 
same covariances (Eqs. (7) and (8)). Let Y 0 , Y x , • • - , Y n be 
n + 1 independent mean-0 variance-1 gaussians. Let 

S. = yfir5Y t -Y 0 ,l<i<n ( 10 ) 

These are, of course, zero-mean joint gaussians (for n> 2). 
What are their covariances? 


by the conditional independence. Here Q is the righthand tail 
of the standard gaussian: 

oo 

QOO = ~ f e- f2 / 2 dt (16) 

We can average Eq. (15) over y> which has the standard 
gaussian distribution, to get the unconditional probability 
that Y f > T 0 /y/n - 2, 1 < / < n . The result (for n > 2) is 

p n = pr(Y. > YjsfT-2 , 1 <i<n) 


We have 


£(5 2 ) = (n-Z)E(Y?) + l 


‘vs Z- e "C^ 2) 


e x dt 
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This is exact. For n = 2,p n = 1/2 = pr(J l2 > 0 ,J 2l > 0). (This 
follows without this method.) We conclude that for n = 2, 
there are F 2 = 2 fixed points on the average. For h = 3, we use 
n - 2 = 1 in Eq. (17) to find 


*>3 



C 3 (0rfQ(0 = -^ 


4 


Thus F 3 = 8p 3 = 2 also. 


is to be the unique maximum, and we must have 

h"(s o )<0 (21) 

conditions which we will check shortly. 

Assuming all this, we have from Eqs. (18) and (19) for n 
large 



(log Q(s) e * 2/2 ) 


S=S 


0 


( 22 ) 


VI. Asymptotic Forts. 

To find F n for large n , let 


s = 


in Eq. (17). The result is 


P 


rt 



Q n (s) e-<"- 2 > j2 / 2 ds 


The next section shows 


s 0 = -0.50605 

— s 2 / 2 

Q(s 0 )e 0 = 0.61023 

e *°l({d* (log G(s) e ~* 2/2) j = L0505 


and so 


p n ~ (1.0505X0.6102)" (23) 


[«*>«-*] V* 08 ) 

This is now in a form ripe for the Laplace or saddle point 
method (Ref. 5, Sec. 4.2). The method implies that for suit- 
able functions g and h (the conditions are satisfied here with 
e h{s) = Q(s) e~ s2 l 2 , g(s ) = e j2 ), we have the asymptotic 
equality 

p e nh ( s J ( — ) 

In this, 

s Q = argmax/i(s) = argmaxe^^ (20) 


From Eq. (13), then, 

F = 2 n p n ~ (1 .0505)(1 .22046)” 
or, in more familiar form, 

F n ~(1.0505)2°‘ 2874 " (24) 

the desired result. 

We note here that the exponent in Eq. (24) agrees with that 
in Ref. 1. But Ref. 1 had at best a logarithmically asymptotic 
answer, not a true asymptotic one, due both to minor errors 
and to the method there. However, Ref. 6 has the correct 
result, although the constants are not specifically worked out 
and the proof is much more complicated (although more 
generalizable) than the one given here. 


212 



VII. Calculation Details 

This last section gives some details of the calculations of the 
preceding section and presents numerical results based on 
evaluating Eq. (18). Note that there is a finite maximum for h 
because = 1 , C(°°) = 0, and h(±°°) = We have 


h(s ) = log Q(s) -s 2 /2,g(s) = s 2 


Thus, 


h'(s) = 



(25) 


(26) 


as the condition on s 0 for the derivative h'(s 0 ) to be zero. We 
see then that s 0 < 0. Continuing, from Eq. (28), 


h"(s Q ) = -2s 2 - 1 < 0 (30) 

Thus, there is a unique maximum on (- 00 , 00 ) and the condi- 
tions for Eq. (19) to hold are satisfied. 


From Eqs. (18), (19), (29), (30), and (9), we now know 
that 



where 


So, what is s 0 ? Calculations on a good personal computer 
show 


m = 


is the unit normal density function. From Eq. (26), 


(27) 


h " ( , _ sZ(s) / z(s ) \ 2 

h (s) - cm" ( e©) - 1 


S 0 = -0.50605 


l-e S °/|s n | = 1.22046 


e °/VTT2^ = 1.0505 
(2 8 ) xhi s completes the derivation of Eq. (24). 


(32) 


To search for a maximum of h(s), we set h'(s) equal to 0 in 
Eq. (26) to obtain 


£Cfol 

2 ( 5 0 ) + S ° 


= o 


(29) 


Table 1 gives comparisons between a numerical evaluation 
of exact expression Eq. (17) times 2 n with the asymptotic 
formula Eq. (24). For n - 2 and 3, the exact answers, as we 
saw in Sec. V, are both 2. Note how good the asymptotic 
values for the expected number of fixed points are even for 
small n. 
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Table 1. Comparison of asymptotic and exact values of F t 


p n 

n 

Exact 

Asymptotic 

2 

2 

1.56 

3 

2 

1.91 

4 

2.40 

2.33 

5 

2.90 

2.84 

6 

3.53 

3.47 

7 

4.29 

4.24 

8 

5.23 

5.17 

9 

6.37 

6.31 

10 

7.76 

7.70 

20 

56.69 

56.48 

100 

4.72E8 

4.72E8 
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